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Welcome to the TestDirector Tutorial 


Welcome to the TestDirector Tutorial, a self-paced guide which teaches you 
how to use TestDirector, Mercury Interactive’s Web-based global test 
management tool. 


This tutorial instructs you on how to use TestDirector to manage the 
application testing process. It familiarizes you with specifying testing 
requirements, planning tests, executing tests, and tracking defects. It also 
shows you how to monitor the testing process by creating reports and 
graphs. 


TestDirector integrates with Mercury Interactive testing tools (WinRunner, 
LoadRunner, QuickTest Professional, Astra QuickTest, QuickTest Professional 
for MySAP.com Windows Client, Astra LoadTest, XRunner, Visual API, and 
Visual API-XP), as well as with third-party and custom testing tools. 


Before You Begin 


In order to do this tutorial, you must have access to the following 
components from your machine: 


V  TestDirector 7.6—Mercury Interactive’s Web-based test management tool. 
You must have access to the following modules: Requirements, Test Plan, 
Test Lab, and Defects. 


Y  TestDirector_Demo—a demonstration project that helps introduce you to 
TestDirector and includes sample requirements, tests, test sets, test runs, and 
defects. 
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J Mercury Tours—a sample application which simulates a Web-based site for 


reserving flights, hotel rooms, car rentals, cruises, and vacation deals. 


Note: To access the TestDirector_Demo and Mercury Tours, you must install 
these components while installing TestDirector. For more information, see 
the TestDirector Installation Guide. 


To run the automated tests used in this tutorial, you also need one of the 
following testing tools: 


WinRunner 7.01 or higher—Mercury Interactive’s enterprise functional 
testing tool for Microsoft Windows applications; or 


QuickTest Professional 5.6 or higher—Mercury Interactive’s functional 
enterprise testing tool; or 


Astra QuickTest 5.6 or higher—Mercury Interactive’s functional enterprise 
testing tool for the Web. 


Note: To launch QuickTest Professional or Astra QuickTest from 
TestDirector, you must also install the QuickTest Professional/Astra 
QuickTest add-in from the TestDirector Add-ins page. Note that in certain 
cases, you must also install the TestDirector Connectivity add-in. For more 
information on installing the add-ins, see the TestDirector Installation Guide. 
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Using This Tutorial 


Lesson 1 


Lesson 2 


Lesson 3 


Lesson 4 


Lesson 5 


Lesson 6 


Lesson 7 


This tutorial contains the following lessons: 


Introducing TestDirector 


Introduces you to the TestDirector testing process, and familiarizes you with 
the TestDirector user interface and the sample Mercury Tours Web site. 


Specifying Testing Requirements 


Shows you how to define requirements, view and modify the requirements 
tree, and convert requirements. 


Planning Tests 


Shows you how to create a test plan tree, design test steps, copy test steps, 
call a test with parameters, link tests to requirements, and automate your 
manual tests. 


Running Tests 


Shows you how to define test sets, schedule test runs, and run manual and 
automated tests. 


Adding and Tracking Defects 


Shows you how to add new defects, search for similar defects, update 
defects, e-mail defects, associate defects with tests, and create favorite views. 


Analyzing the Testing Process 


Shows you how to monitor the testing process by creating reports and 
graphs. 


Where Do You Go from Here? 


Shows you how to get started testing your own application and where to 
find more information about TestDirector. 
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Typographical Conventions 


viii 


This book uses the following typographical conventions: 


1, 2, 3 
> 


> 


Stone Sans 


Bold 


Italics 


Helvetica 


<> 


Bold numbers indicate steps in a procedure. 
Bullets indicate options and features. 


The greater than sign separates menu levels (for 
example, File > Open). 


The Stone Sans font indicates names of interface 
elements in a procedure that you perform actions 
upon (for example, “Click the Run button. ”). 


Bold text indicates function names. 


Italic text indicates variable names, or introduces a 
new term. 


The Helvetica font is used for examples and statements 
that are to be typed in literally. 


Angle brackets enclose a part of a URL address that 
needs to be typed in. 


In a line of syntax, an ellipsis indicates that more items 
of the same format may be included. 
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Introducing TestDirector 


Application testing is a complex process. TestDirector helps you organize 
and manage all phases of the application testing process, including 
specifying testing requirements, planning tests, executing tests, and tracking 
defects. 


Ej f= In this lesson, you will learn about: 


The TestDirector Testing Process 
Starting TestDirector 


The TestDirector Window 


vVvVvY 


The Mercury Tours Sample Web Site 


The TestDirector Testing Process 


TestDirector offers an organized framework for testing applications before 
they are deployed. Since test plans evolve with new or modified application 
requirements, you need a central data repository for organizing and 
managing the testing process. TestDirector guides you through the 
requirements specification, test planning, test execution, and defect 
tracking phases of the testing process. 


The TestDirector testing process includes four phases: 


a Fay F%™& 


Specifying Planning Running Tracking 
Requirements Tests Tests Defects 
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Specifying Requirements 


You begin the application testing process by specifying testing requirements. 
In this phase you perform the following tasks: 


Task Description 


Define Testing Scope Examine application documentation in order to 
determine your testing scope—test goals, objectives, 
and strategies. 


Create Requirements Build a requirements tree to define your overall testing 
requirements. 
Detail Requirements For each requirement topic in the requirements tree, 


create a list of detailed testing requirements. Describe 
each requirement, assign it a priority level, and add 
attachments if necessary. 


Analyze Requirements Generate reports and graphs to assist in analyzing your 
Specification testing requirements. Review your requirements to 
ensure they meet your testing scope. 


Planning Tests 


You create a test plan based on your testing requirements. In this phase you 
perform the following tasks: 


Task Description 


Define Testing Strategy | Examine your application, system environment, and 
testing resources in order to determine your testing 
goals. 


Define Test Subjects Divide your application into modules or functions to 
be tested. Build a test plan tree to hierarchically divide 
your application into testing units, or subjects. 


Define Tests Determine the types of tests you need for each 
module. Add a basic definition of each test to the test 
plan tree. 

Create Requirements Link each test with a testing requirement(s). 

Coverage 
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Task 


Description 


Design Test Steps 


Develop manual tests by adding steps to the tests in 
your test plan tree. Test steps describe the test 
operations, the points to check, and the expected 
outcome of each test. Decide which tests to automate. 


Automate Tests 


For tests that you decide to automate, create test 
scripts with a Mercury Interactive testing tool, or a 
custom or third-party testing tool. 


Analyze Test Plan 


Generate reports and graphs to assist in analyzing test 
planning data. Review your tests to determine their 
suitability to your testing goals. 


Running Tests 


Once you build a test plan tree, you run your tests to locate defects and 
assess quality. In this phase you perform the following tasks: 


Task 


Description 


Create Test Sets 


Define groups of tests to meet the various testing goals 
in your project. These might include, for example, 
testing a new version or a specific function in an 
application. Determine which tests to include in each 
test set. 


Schedule Runs 


Schedule test execution and assign tasks to testers. 


Run Tests 


Execute the tests in your test set automatically or 
manually. 


Analyze Test Results 


View the results of your test runs in order to determine 
whether a defect has been detected in your 
application. Generate reports and graphs to help 
analyze these results. 
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Tracking Defects 


Locating and repairing application defects efficiently is essential to the 
testing process. Defects can be detected and added in all stages of the testing 
process. 


In this phase you perform the following tasks: 


Task Description 


Add Defects Report new defects detected in your application. 
Quality assurance testers, developers, project 
managers, and end users can add defects during any 
phase in the testing process. 


Review New Defects Review new defects and determine which ones should 
be fixed. 

Repair Open Defects Correct the defects that you decided to fix. 

Test New Build Test a new build of your application. Continue this 


process until defects are repaired. 


Analyze Defect Data Generate reports and graphs to assist in analyzing the 
progress of defect repairs, and to help determine when 
to release the application. 
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Starting TestDirector 


To get started, you need to launch TestDirector in your Web browser. 
To start TestDirector: 
1 Open the TestDirector Options window. 


In your Web browser type your TestDirector URL: 
http://[ TestDirector server name}/[virtual directory name)/default.htm 


The TestDirector Options window opens. 


TestDirector 7.6 wi 


TestDirector 
Site Administrator 
Add-ins Page 


ReadMe 


Note: If you cannot start TestDirector, contact your system administrator to 
ensure that TestDirector has been installed on your company Web server. 
For more information, refer to the TestDirector Installation Guide. 
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2 Open TestDirector. 
Click the TestDirector link. 


The first time you run TestDirector, the application is downloaded to your 
computer. Subsequently, TestDirector automatically carries out a version 
check. If it detects a newer version, it downloads it to your machine. 


The TestDirector Login window opens. 


CUSTOMIZE HELP 


© Site Administrator 
© Add-ins Page 
© Mercury Interactive on the Web 
© About TestDirector 


Project: User ID: Password: 


TestDirector_Demo X admin ] X 


~ 
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3 Select a domain. 


In the Domain list, select the DEFAULT domain. 


4 Select a project. 


In the Project list, select the TestDirector_Demo. This is the demonstration 
project that you will use to do this tutorial. The project is based on the 
Mercury Tours sample application. It includes requirements, tests, test sets, 
test runs, and defects. 
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5 Log in to the project as a QA tester. 


In the User ID box, type one of the following user names: alice_td, cecil_td, 
or michael_td. 


Skip the Password box. A password was not assigned to any of the above 
user names. 


Click the Login button. 


TestDirector opens and displays the module in which you were last working. 
In the title bar, TestDirector displays the project name and your user name. 


Modules P 
<> @ y pim?) | TestDirector 7.6 Qi. 

Project name T Project : TestDirector_Demo [michag TOOLS HELP LOGOUT 
Requirements View Tools Analys 

User name 


The TestDirector Window 


In the following exercise, you will explore the TestDirector modules and 
their common elements. 


To explore the TestDirector window: 
1 Explore the TestDirector modules. 


> Click the Requirements tab. The Requirements module enables you to 
specify your testing requirements. This includes defining what you are 
testing, defining requirement topics and items, and analyzing the 
requirements. 


> Click the Test Plan tab. The Test Plan module enables you to develop a 
test plan. This includes defining goals and strategy, dividing your plan 
into categories, developing tests, automating tests where beneficial, and 
analyzing the plan. 


> Click the Test Lab tab. The Test Lab module enables you to run tests on 
your application and analyze the results. 


> Click the Defects tab. The Defects module enables you to add defects, 
determine repair priorities, repair open defects, and analyze the data. 
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TestDirector 
toolbar 


Menu bar 
Module toolbar 


Tools button 


Help button 


Logout button 


2 Explore the common TestDirector elements. 


All the TestDirector modules have common elements. For example, click the 
Requirements tab. 


a yun x. @ TestDirector 7.6 Qi. 


T Project : TestDirector_Demo [michaq TOOLS HELP LOGOUT 
Requirements View Tools Analysis 


Document View EZ 


& %|% & @~ x 


8-H) S-S|& 0a 


4) Author 


z 
Fy 
a 


[RQ0003) @ Mercury Tours Application alex_td 01/09/2001 9:07:29 AM robert_td 5-Urgent Fundtional | 
[RQ0020]  @ Application Security alextd 01/09/2001 1:15:09PM  3€ Failed Reviewed robert_td sh Standard 
Rao HT @ Application Client System shelly ia UTTS200T T2356 AM 2 Faled Reviewed alex td 3-High System 
[RQ0045] Œ è Application Usability shelly td 0115/2001 11:33154M 3 Failed Reviewed alextłd 5-Urgent Qualty 
RQ0046] E @ Application Performance shelly td 0145/2001 11:34:29AM_ X Failed Reviewed alextd  5-Urgent  Qualty 
[RQ0047] @ Application Reliability shelly_td 01/15/2001 11:35:06 AM yf Passed Reviewed alextd 5-Urgent Quality 
[RQ0008) è Profile Management alex_td 01/09/2001 9:20:334M È Failed Reviewed alextd  4-Very High Functional 
[R@0007) @ Booking System alextd 01/09/2001 9:19194M 3€ Failed Reviewed roberttd 5-Urgent Functional 
[RQ0011] Æ @ Flights Reservation Service = alex_td 01/09/2001 10:16:394M %€ Failed Reviewed roberttd 5-Urgent Functional 
[RQ0071] @ Reservations Management robert_td 01/25/2001 12:59:44PM y’ Passed Reviewed alextd 3-High Functional 


t Description ‘AEA 


7 


> The TestDirector toolbar, located directly above the TestDirector project 
name. If the toolbar is not visible, click the Show Toolbar button. The 
toolbar contains the following buttons: 


Button Description 


[x] Navigates back to your previous location in 
TestDirector. 


If you navigated back, enables you to navigate 
forward. 


Ka 


Logs out and takes you to the TestDirector Login 
window. 


S 


wy Checks the spelling for the selected word or text box. 

If there are no errors, a confirmation message opens. 
If errors are found, the Spelling dialog box opens and 
displays the word together with replacement 
suggestions. 


Opens the Spelling Options dialog box, enabling you 
to configure the way TestDirector checks spelling. 


B 


LOGOUT 
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Button Description 


= 7 Opens the Thesaurus dialog box and displays a 

synonym, antonym, or related word for the selected 
word. You can replace the selected word or look up 
new words. 


FA Opens the Add Defect dialog box, enabling you to add 
a new defect. 


B Opens the Online Help and displays the help topic for 
the current context. 


The menu bar, located directly below the TestDirector project name, 
displays the names of menus from which you select commands. 


The module toolbar, located below the menu bar, contains buttons for 
frequently-used commands in the current TestDirector module. 


The Tools button, located on the upper-right side of the window, enables 
you to change your user password and other user properties, clear the 
history data, set reading order, view version information for each 
TestDirector client component, and open the Document Generator. 


The Help button, located on the upper-right side of the window, enables 
you to access TestDirector online resources. 


The Logout button, located on the upper-right side of the window, 
enables you to exit and return to the TestDirector Login window. 
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The Mercury Tours Sample Web Site 


Mercury Tours is the sample Web application used in lessons of this tutorial. 
It simulates a Web-based application for reserving flights, hotel rooms, car 
rentals, cruises, and vacation deals. You should now familiarize yourself 
with this application. 


To explore Mercury Tours: 
1 Open the Mercury Tours application. 


Open a separate instance of your Web browser, and type the following URL: 
http://[ TestDirector server name]/mtours/index.html 


Make sure to replace [TestDirector server name] with your actual TestDirector 
server name. The Mercury Tours home page opens. 


F Welcome: Mercury Tours - Microsoft Internet Explorer 
| File Edit View Favorites Tools Help 


Pee oe 


Back Forward Stop Refresh Home 


aa 3j g 


Search Favorites History Mail Print 


| Address 4) http://servemame/mtours/servlet/welcomeServlet v| @Go | Links ? 


May 20, 2002 


Registered users can sign-in 
here to find the lowest fare on 
participating airlines 


User Name: 
Password: 


This island is surrounded by coral reefs, 


SAVINGS! 
Rent ACar 


CUCK HERE 


offers guaranteed sunshine and is blessed 
with beautiful beaches. Luxury resorts have 
taken up residence along most of the 
beachfronts on the southern coast, but 
there are still undeveloped areas on the 
exposed northern coast, and much of the 
interior is inhabited by nothing more 
substantial than goats. 


Atlanta to Las Vegas 
Boston to San Fransisco 
Los Angeles to Chicago 
New York to Chicago 
Phoenix to San Fransisco 


Find detailed 
information about 


your destination. 


Read about our 
featured vacation 
destinations. 


Register here to 
join Mercury 


Tours! 


10 


Lesson 1 ¢ Introducing TestDirector 


2 Subscribe to Mercury Tours. 


Click Register. The Register page opens. 


To create your account, we'll need some basic information about you. This 
information will be used to send reservation confirmation emails, mail tickets when 
needed and contact you if your travel arrangements change. Please fill in the forrn 
completely. 


Note: Please fill all fields bellow to complete the registration. 


Contact Information 


First Name: C—O] 

VERSION LatNam: | S 

Phone: [sid 

Email: Lo E] 


Mailing Information 


Address: l 

City: l 

State/Province: l 

Postal Code: l 
Country: [UNITED STATES z] 


User Information 


User Name: l 
Password: l 
Confirm Password: l 


Under Contact Information, type your name, phone number, and e-mail 
address. 


Under Mailing Information, type your mailing address. 


Under User Information, in the User Name box, type mercury. In the 
Password box, type mercury. In the Confirm Password box, type mercury. 


Click Submit. A confirmation of your registration is displayed in the Register 
page. 
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3 Log in to Mercury Tours. 


Click the sign-in link. The Sign-on page opens. 


-\ one cool summer 
ae 


Welcome back to Mercury Tours! Enter your user information to access the 
member-only areas of this site. If you dont have a log-in, please fill out the 
registration form. 


User Name: 
Password: 


Use Java 


© 2000, Mercury Interactive (v. 020213-1.01-061) 


SAVINGS! 
Rent ACar 


— 
CUCK HERE 


In the User Name box, type mercury. In the Password box, type mercury. 
Click Submit. 
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The Flight Finder page opens. 


~\ one cool summer D 
an 


Use our Flight Finder to search for the lowest fare on participating airlines. Once 
youve booked your flight, don't forget to visit the Mercury Tours Hotel Finder to 
reserve lodging in your destination city. 


Flight Details 
Type: © Round Trip © One Way 


Passengers: pa 
Departing From: [Acapulco = 
VERSION On: [May =] [20 =] __ViewCalendar | 
: Arriving In: [zurich 
Returning: [May =] [21 m] View Calender | 


SAVINGS! 
Rnt Acar Preferences 


— Service Class: @ Economy class 


CUCK HERE ; 
C Business class 


© First class 


Airline: [No Preference 7] 


4 Reserve a flight. 
Follow the on-screen instructions to reserve a flight. 
5 Explore other options. 


Explore the following options: Hotels, Car Rentals, Cruises, Destinations, 
and Vacations. 


6 End your Mercury Tours session. 
Click SIGN-OFF to log out. 
H F Now that you are familiar with the TestDirector testing process, the 


TestDirector modules, and the Mercury Tours sample Web site, you can 
proceed to Lesson 2, “Specifying Testing Requirements.” 
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Specifying Testing Requirements 


|a 


Yv Yyy 


You begin the testing process by specifying testing requirements in 
TestDirector’s Requirements module. Requirements describe in detail what 
needs to be tested in your application and provide the test team with a 
foundation on which the entire testing process is based. 


You define the requirements in TestDirector by creating a requirements tree. 
This is a graphical representation of your requirements specification, 
displaying your requirements hierarchically. You can group and sort 
requirements in the tree, monitor task allocation and progress of 
requirements, and generate detailed reports and graphs. 


Once you have created tests in the Test Plan module, you can link 
requirements to tests (you will do so, in “Planning Tests” on page 27), and 
associate them with defects (you will do so, in “Adding and Tracking 
Defects” on page 75). In this way, you can keep track of your testing needs at 
all stages of the testing process. If a testing requirement changes, you can 
immediately identify which tests and defects are affected, and who is 
responsible. 


In this lesson, you will learn about: 


Defining Requirements 
Viewing Requirements 
Modifying Requirements 


Converting Requirements 
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Defining Requirements 


In the following exercise, you will define requirements for testing the 
functionality of reserving cruises in Mercury Tours. 


To define a requirement: 
Open the TestDirector_Demo project. 


If the TestDirector_Demo project is not already open, log in to the project. 
For more information, see “Starting TestDirector,” on page 5. 


Display the Requirements module. 


Click the Requirements tab. The Requirements module displays the 
requirements tree. 


Display the requirement tree in Document View. 


Select the Document View of the requirement tree. 


4 Project : TestDirector_Demo [michae 


Requirements View Tools Analysis 


a X|- mlo- Alh B 
4 Cover Status > ReqID 
& Failed [R@0003] 


+ @ Mercury Tours Application 


Create a new requirement. 


Click the New Requirement button on the Requirements module toolbar. 
Alternatively, choose Requirements > New Requirement. The New 
Requirement dialog box opens. 


Select values for the following required fields: 


[oc] [ conca ] 


In the Name box, type Cruise Reservation. 
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In the Product box, select Mercury Tours (HTML Edition). 
In the Priority box, select 4-Very High. 
In the Type box, select Functional. 


Click OK. TestDirector adds the Cruise Reservation requirement to the 
requirements tree. 


Add a sub-requirement. 


Click the New Child Requirement button to add the next requirement 
underneath the Cruise Reservation, at a lower hierarchical level. The New 
Requirement dialog box opens. 


In the Name box, type Cruise Search. 

In the Product box, select Mercury Tours (HTML Edition). 
In the Priority box, select 4-Very High. 

In the Type box, select Functional. 


Click OK. TestDirector adds the Cruise Search requirement, under the Cruise 
Reservation requirement. 


Add an additional sub-requirement. 
In the requirements tree, select the Cruise Reservation requirement. 
Repeat step 5. This time in the Name box, type Cruise Booking. 


TestDirector adds the Cruise Booking requirement, under the Cruise 
Reservation requirement. 


Requirements View Tools Analysis 


Document View Eq 


S$ &|s wa-x|s-H|o-o|f oa 

[Ble ReqiID Name 4| Author | Creation ...| Creation Ti... | Cover Status! Reviewed | Priority | Type | 
[R@0003]  @ Mercury Tours Application alex_td 01/09/2001 9:07:294M  3¢ Failed Reviewed 5-Urgent Functional 
[RQ0140] © @ Cruise Reservation admin 05/22/2002 1:20:09 PM ? Not Coverdot Revie... 4-Very High Functional 
[RQ0141] o Cruise Search admin 05/22/2002 2:40:01 PM 2? Not Coverdot Revie... 4-Very High Functional 
[RQ0142] o Cruise Booking admin 05/22/2002 2:51:04 PM ® Not Coverdot Revie... 4-Very High Functional 
[RQ0020] H è Application Security alextd 0109/2001 1:15:09PM J€ Failed Reviewed 5-Urgent Standard 
[RQ0042] Œ è Application Client System shelly_td 01/15/2001 11:23:56 AM € Failed Reviewed 3-High System 
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You can change the way TestDirector displays requirements in the 
requirements tree. In the following exercise, you will learn how to zoom in 
and out of the tree, display numeration, refresh the tree, and expand and 
collapse the branches of the tree. 


To view requirements: 
Display the Requirements module. 


Click the Requirements tab. The Requirements module displays the 
requirements tree. 


Make sure the requirements tree is displayed in Document view. 
Zoom in and out of the requirement. 
To zoom in, select Cruise Reservation in the requirements tree. 


Click the Zoom In button on the toolbar. Alternatively, right-click the 
requirement and choose Zoom In. The requirements tree only displays the 
Cruise Reservation requirement, including its two sub-requirements. 


Requirements View Tools Analysis 
Document View Ba 


Sales e@a-x|s-H/o-S|&o0 
Zoomed in to: Cruise Reservation 
| Name 4| Cover Status | © Regd 
o Cruise Search ? Not Covered [RQ0141] 
o Cruise Booking ? Not Covered [RQ0142] 


To reverse a zoom in action, click the Zoom In arrow, and choose Zoom Out 
To Root. The entire requirements tree is displayed. 
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3 Display numeration in the requirements tree. 


To assign hierarchical numbers to each requirement in the tree, choose 
View > Numeration. As you make changes to the tree, TestDirector 
automatically renumbers the requirements. Note that the numbers are not 
related to the unique Req ID assigned to each requirement. 


+] 1- Mercury Tours Application X Failed [RQ0003] 
=| 2 - Cruise Reservation ? Not Covered [RQ0140] 
2.1 - Cruise Search ? Not Covered [RQ0141] 

2.2 - Cruise Booking ? Not Covered [RQ01 42] 

E 3- Application Security & Failed (RQ0020) 
E 3.1- Access Authorization X Failed [RQ0021] 


4 Refresh the data in the Requirements module. 


AE To refresh a requirement, select the requirement and click the Refresh 
= Selected button. All children of the requirement are also refreshed. 


To refresh all requirements, click the Refresh Selected arrow and choose 
Refresh All. 


5 Expand and collapse the requirements. 


To expand all the levels in a requirement, right-click a requirement and 
choose Expand. 


To collapse all the levels in a requirement, right-click a requirement and 
choose Collapse. 


19 


TestDirector Tutorial 


Modifying Requirements 


20 


You can modify the requirements in the requirements tree. In the following 
exercise, you will learn how to copy, rename, move, or delete requirements. 


To modify requirements: 
Display the Requirements module. 


Click the Requirements tab. The Requirements module displays the 
requirements tree. 


Copy a requirement. 


In the requirements tree, select the Cruise Reservation requirement and click 
the Copy button. 


Click the Paste arrow and choose Paste. 


A message box opens. Click OK. The requirement is pasted underneath the 
selected requirement, at the same hierarchical level. Copy_ is added to the 
end of the requirement’s name. 


Rename the Cruise Reservation_Copy_ requirement. 

Right-click the Cruise Reservation_Copy_ requirement and choose Rename. 
Edit the requirement name to Hotel Reservation. 

Press Enter. 


Move the Hotel Reservation requirement to a different location in the 
requirements tree. 


Select the Hotel Reservation requirement. 
Click the Cut button. 
Select the Reservations Management requirement. 


To paste the Hotel Reservation requirement underneath the selected 
requirement, click the Paste arrow and choose Paste as Child. 
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Click Yes to confirm. 


= @ Reservations Management vV Passed [RQ0071] robert_td 
o View Reservations v Passed [RQ0072] robert _td 

o Cancel Reservations W? Passed [RQ0073] robert_td 

=] + Hotel Reservation ? Not Covered [RQ0141] michael_td 

a Cruise Search ? Not Covered [RQ01 42) michael_td 

a Cruise Booking ? Not Covered [RQ01 43) michael_td 


Adi, 


Tip: You can also drag requirements to a new location in the requirements 
tree. 


i 


bi 


5 Delete the Hotel Reservation requirement. 
Select the Hotel Reservation requirement. 


x Click the Delete button, or choose Requirements > Delete. 


Click Yes to confirm. 


Converting Requirements 


Once you have created the requirements tree, you use the requirements as a 
basis for defining your test plan tree in the Test Plan module. You can use 
the Convert to Tests wizard to assist you when designing your test plan tree. 
The wizard enables you to convert selected requirements or all requirements 
in the requirements tree to tests or subjects in the test plan tree. 


In the following exercise you will convert the Cruise Reservation 


requirement to a subject in the test plan tree. Its sub-requirements will be 
converted to tests. 
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To convert a requirement: 
1 Display the Requirements module. 


Click the Requirements tab. The Requirements module displays the 
requirements tree. 


2 Select a requirement. 
In the requirements tree, select the Cruise Reservation requirement. 
3 Open the Convert to Tests wizard. 


Choose Tools > Convert to Test > Convert Selected. The Step 1 dialog box 
opens. 


B Step 1 of 3: Choose an automatic conversion method BEE 
Converting: Cruise Reservation 


Automatic Conversion Method: 
®© Convert lowest child requirements to 5 Req 1 
design steps. E- Mt Req 2 
® Req3 


© Convert lowest child requirements to 3 Req 1 
tests. E Req 2 
M Req3 


© Convert all requirements to subjects. I Req 1 
o- Req 2 
E Req 3 


a) CT] 


4 Choose an automatic conversion method. 


Select Convert all requirements to subjects to convert all selected 
requirements to subjects. 
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5 Start the conversion process. 


Click Next to begin converting the requirements. When the conversion 
process is complete, the results are displayed in the Step 2 dialog box. 


Bs Step 2 of 3: Manual changes to the automatic conversion -ioj x} 
Converting: Cruise Reservation 


Auto Complete Children 


[æ] [e e] 
= © Cruise Reservation 
(9 Cruise Search 
(9 Cruise Booking 


Legend 


6 Convert sub-requirements to tests. 
Select Cruise Search, and click the Test button. 


Select Cruise Booking, and click the Test button. 
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Click Next. The Step 3 dialog box opens. 


fii. Step 3 of 3: Choose the destination subject path -Ioj x] 


7 Choose the destination subject path. 


In the Destination Subject Path, click the browse button. The Select 
Destination Subject dialog box opens. 
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Select Cruises from your test plan tree. 


Select Destination Subject Ea 


E3 Subject 

? Unattached 

(9 Mercury Tours Site 
(> Profiling 


+) 


E ttinerary 
{9 Compiled Modules 


+ A a 


Click OK to close the Select Destination Subject dialog box. The Destination 
Subject Path box now indicates the following path: 


Destination Subject Path: 


SubjectiCruises) ES 


8 Finalize the conversion process. 

Click Finish. 

Click OK in the Information dialog box to close the Convert to Tests wizard. 
9 View the converted requirements in the test plan tree. 

Click the Test Plan tab to display the Test Plan module. 


In the test plan tree, select Cruises and click the Refresh Selected button. 
= The test plan tree displays Cruise Reservation under Cruises. 
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Expand Cruise Reservation. The test plan tree displays Cruise Booking and 
Cruise Search as manual tests. 


E3 Subject 

+) P Unattached 

(9 Mercury Tours Site 

E Profiling 

(9 Flight Reservation 

-3 Cruises 

=|-4Q Cruise Reservation 
M Cruise Booking 
M Cruise Search 

(9 Itinerary 

(9 Compiled Modules 


+) ~~ 


+] 


F 


| Now that you are familiar with defining requirements, viewing and 

ie modifying the requirements tree, and converting requirements, you can 
proceed to Lesson 3, “Planning Tests”. In Lesson 3, you will learn how to 
define your test plan tree. 
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Planning Tests 


| 


VvVvVvVvVVY 


After you define your requirements, you need to determine your testing 
goals. Examine your application, system environment, and testing process 
to outline the testing strategy for achieving your goals. 


After you determine your testing goals, you build a test plan tree to 
hierarchically divide your application into testing units, or subjects. For each 
subject in the test plan tree, you define and design tests. 


When you define steps for a test, you provide the actions to be performed 
on your application, the input to be entered, and the expected output. To 
increase the flexibility of a test, you can add parameters. 


To keep track of the relationship between your tests and requirements, you 
can add links between them. By creating these links, you can ensure 
compliance with your requirements throughout the testing process. 


Once you design your tests, you can decide which tests to automate. If you 
choose to automate a test, you can generate a test template and then 
complete it using other Mercury Interactive testing tools (for example, 
WinRunner, QuickTest Professional, or Astra QuickTest). 


In this lesson, you will learn about: 


Developing a Test Plan Tree 
Designing Test Steps 

Copying Test Steps 

Calling Tests with Parameters 
Creating Requirements Coverage 


Generating Automated Test Templates 
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The typical application is too large to test as a whole. The Test Plan module 
enables you to divide your application according to functionality. You 
divide your application into units, or subjects, by creating a test plan tree. 
This is a graphical representation of your test plan, displaying your tests 
according to the hierarchical relationship of their functions. After you 
define subjects in the tree, decide which tests to create for each subject and 
add them to the tree. 


In the Requirements module, you converted the Cruise Reservation 
requirement, and its sub-requirements to subjects and tests in the test plan 
tree (see “Converting Requirements,” on page 21). In the following exercise, 
you will add a subject and a test to the test plan tree from the Test Plan 
module. 


To develop a test plan tree: 
Open the TestDirector_Demo project. 


If the TestDirector_Demo project is not already open, log in to the project. 
For more information, see “Starting TestDirector,” on page 5. 


Display the Test Plan module. 
Click the Test Plan tab. 
Add a subject folder to the test plan tree. 


Select the Cruises subject folder, and click the New Folder button. The New 
Folder dialog box opens. 


New Folder xi 


Folder Name : 


In the Folder Name box, type Cruise Cancellation. Click OK. The new subject 
folder appears under the Cruises subject folder in the test plan tree. 


Lesson 3 ¢ Planning Tests 


In the Description tab, type a description of the subject. For example, 
type: This folder contains tests that verify the Cancel Reservation functionality. 


Click the Attachments tab. In this tab, you can add an attachment to the 
new folder if necessary. For the purpose of this exercise, ignore this tab. 


Add a test to the test plan tree. 


Select the Cruise Cancellation subject folder, and click the New Test button. 
The Create New Test dialog box opens. 


Create New Test xi 
Test Type: | MANUAL M 


In Test Type box, select WR-AUTOMATED to create a WinRunner test, or 
select QUICKTEST-TEST to create a QuickTest Professional/Astra QuickTest 
test. 


In the Test Name box, type a name for the test. For example, type: Cancel All 
Reservations. 


Click OK. The Required Fields dialog box opens. 


Select values for the following required fields: 


eT] Cee 


In the Level box, select Basic. 

In the Reviewed box, select Not Reviewed. 
In the Priority box, select 4-Very High. 
Click OK. 
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The new test is added to the test plan tree under the Cruise Cancellation 
subject folder. 


E Subject 
+)? Unattached 
+) Compiled Modules 


=) Q Cruises 
B- Cruise Cancellation 
lid Cancel All Reservations 


=)49 Cruise Reservation 
M Cruise Booking 
M Cruise Search 


Add a test description. 


Make sure to display the Details tab. By default, the Details tab shows the 
test name, test creator, creation date, and test status. 


In the Description box, type a description for the test. For example, type: 
The test verifies cancellation of cruise reservations in the Itinerary page. 


Display the Design Steps tab. 


Click the Design Steps tab. In the Design Steps tab you define your test 
steps. For the purpose of this exercise, ignore this tab. You will define test 
steps in the “Designing Test Steps” exercise on page 31. 


Display the Test Script tab. 


Click the Test Script tab. In the Test Script tab, you can view the test script of 
a test. For the purpose of this exercise, ignore this tab. You will create an 
automated test template in the “Generating Automated Test Templates” 
exercise on page 44. 


Display the Attachments tab. 


Click the Attachments tab. In the Attachments tab, you can view the list of 
attachments that provide additional information on the test. An attachment 
can be a file, URL, snapshot of your application, an image from the 
Clipboard, or system information. For the purpose of this exercise, ignore 
this tab. 
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9 Display the Reqs Coverage tab. 


Click the Reqs Coverage tab. In the Reqs Coverage tab you can view a list of 
the requirements that are covered by the selected test. For the purpose of 
this exercise, ignore this tab. You will link requirements to a test in the 
“Creating Requirements Coverage” exercise on page 44. 


Designing Test Steps 


After you add a test to the test plan tree and define basic test information, 
you define test steps—detailed, step-by-step instructions on how to execute 
a test. A step includes the actions to be performed on your application, the 
input to be entered, and the expected output. A step can also include 
parameters. 


You can create test steps for both manual and automated tests. For a manual 
test, you complete test planning and design once you finish creating the 
steps. Using your plan, you can begin execution immediately. Automated 
tests require that you create an automated test script using a Mercury 
Interactive testing tool, or a custom or third-party testing tool. 


In the following exercise, you will create the Cruise Booking test. This test 
verifies the process of booking a cruise through the Mercury Tours site. 


To design a test step: 

1 Display the Test Plan module. 
Click the Test Plan tab. 

2 Display the Cruise Booking test. 


Under the Cruise Reservation folder, select the Cruise Booking test. 
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3 Open the Design Step Editor. 


Click the Design Steps tab. 
Click the New Step button. The Design Step Editor opens. 


88 Design Step Editor 


Mo "| a x| 0 Pp X B| E| cose 


Description: 


Expected Result: 


The Test Plan module displays a step name in the Step Name box. The 
default name is the sequential number of the test step (Step 1 if you are 


adding steps to a test for the first time). 
Define a step for displaying the Cruise Special page. 


In the Step Name box, type a descriptive name for the step. For example, 


type: Display the Cruise Special page. 


In the Description box, type the procedure for the step. For example, type: 


Click the Cruises button. 


se 


se 
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In the Expected Result box, type the expected output. For example, type: 
The Cruise Special page opens. 


88 Design Step Editor 


a "|x “ 8 A w Bl Gh | cose 


Description: 
Click the Cruises button. 


Expected Result: 
The Cruise Special page opens. 


5 Define a step for reserving the cruise. 


Click the Add Step button. 

In the Step Name box, type: Display the Cruise Reservation page. 

In the Description box, type: Click the Now Accepting Reservations button. 
In the Expected Result box, type: The Cruise Reservation page opens. 
Define a step for booking the cruise. 

Click the Add Step button. 

In the Step Name box, type: Book the cruise. 


In the Description box, type: Enter passenger name, credit card information, 
and address. Click OK. 


In the Expected Result box, type: The Cruise Confirmation page opens. 
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7 Define a step for printing the cruise confirmation information. 


Click the Add Step button. 


In the Step Name box, type: Print cruise confirmation. 


In the Description box, type: Click the Print button. 


In the Expected Result box, type: A confirmation page is printed. 


8 Define a step for logging off the Mercury Tours site. 


Click the Add Step button. 


In the Step Name box, type Log off. 


In the Description box, type: Click the Sign-Off button. 


In the Expected Result box, type: Returns to the Sign-On page. 


9 Close the Design Step Editor. 


Click Close. The designed steps are displayed in the Design Steps tab. 


Display the Cruise 
Special page 


Display the Cruise 
Reservation page 


Book the cruise 
Print cruise 
confirmation. 


Log off 


_ Design Steps 


Test Script 


Click the Cruises button. 

Click the Now Accepting Reservations button. 
Enter passenger name, credit card information, and 
address. Click OK. 


Click the Print button. 


Click the Sign-Off button. 


Attachments | & Reqs Coverage 


m <p> | P =] 
E CE ES eT 


The Cruise Special page opens. 


The Cruise Reservation page opens. 


The Cruise Confirmation page opens. 


A confirmation page is printed. 


Returns to the Sign-On page. 
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Copying Test Steps 


You can copy steps from another test in the same project or a different 
project. In the following exercise, you will copy the test steps from the 
Cruise Booking test and paste them into the Cruise Search test. In 
“Generating Automated Test Templates” on page 44, you will automate the 
Cruise Search test. 


To copy a test step: 
1 Display the Design Steps tab for the Cruise Booking test. 


In the test plan tree, under the Cruise Reservation folder, select the Cruise 
Booking test. 


Click the Design Steps tab. 
2 Select the steps that you want to copy. 


Press the Ctrl or Shift key and select the first column (shaded a gray or 
brown color) of all the steps. 


ES" Details $e Design Steps Test Script Attachments | & Reqs Coverage 
: | | 3 = | g | 
a @%/x|O a| S-|m elg ole tal 


button 


HEMT 


Click the Noy 


1, credit card information, and 


Log off 


3 Copy the selected steps. 
Eal Click the Copy Steps button. 
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4 Paste the steps to the Cruise Search test. 


In the test plan tree, under the Cruise Reservation folder, select the Cruise 
Search test. 


In the Design Steps tab, click the Paste Steps button. The test steps appear 
in the Design Steps tab. 


Calling Tests with Parameters 
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When you design test steps, you can include a call to a manual test. When 
you run the test, the test steps include the steps from the called test as part 
of the test. Generally, the test that you call is a template test. A reusable test 
that can be called by different tests. A template test generally includes 
parameters. A parameter is a variable that replaces a fixed value and can be 
assigned a value from outside the test in which it is defined. You can change 
the value of a parameter in a test according to the test that is calling it, or for 
different instances of a test. 


For example, suppose you have a template test which logs in a user with a 
specific password when you start your application. You need to call this test 
at the beginning of each test. In some cases, you will want to log in as a 
regular user while in others, you will need to log in as the administrator. You 
can therefore create two parameters, <<user name>> and <<password>>, and 
change the value according to which type of test is calling your template 
test. 


In “Designing Test Steps” on page 31, you created a test for booking a cruise. 
In the following exercise, you will enhance your test by calling the Connect 
And Sign-On test. This is a template test which includes parameters for the 
Mercury Tours URL address, and the user name and password for logging in 
to the site. 


Lesson 3 ¢ Planning Tests 


To call a test with parameters: 
1 Display the Design Steps tab for the Cruise Booking test. 


In the test plan tree, under the Cruise Reservation folder, select the Cruise 
Booking test. 


Click the Design Steps tab. 


2 Select the test with parameters that you want to call. 


Click the Call to Test button. The Select a Test dialog box opens. 
“ap 


£ Subject 

? Unattached 

(9 Compiled Modules 
E Cruises 

(9 Flight Reservation 
(9 ttinerary 

(9 Mercury Tours Site 
(9 Profiling 


+) AE 


Show only Template Tests 


To locate the Connect And Sign-On test, in the Find box, type Connect, and 
click the Find button. TestDirector highlights the test. 
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Click OK. A dialog box opens, displaying the parameters contained in the 
called test. 


Connect And Sign-On xi 


mercury tours url 


password 
user name 


3 Assign values for the parameters. 


Click the Value box for the mercury tours url parameter, and type: 
http://[ TestDirector server nameļ/mtours/index.html 


Make sure to replace [TestDirector server name] with your actual TestDirector 
server name. 


Click the Value box for the user name parameter, and type your user name 
(use the same name as the one used in “The Mercury Tours Sample Web 
Site” on page 10). 


Skip the value for the password parameter. You will assign a value to this 
parameter when you run your test ( “Running Tests Manually” on page 61). 


Lesson 3 ¢ Planning Tests 


Note: You can also assign values to parameters when you create a test to call 
your test, when you add your test to a test set, or when you run your test. 


Click OK. The Call Connect And Sign-On step is added to your designed 
steps. 


Reorder the steps. 


In the Design Steps tab, select the first column (shaded a gray or brown 
color) of the Call Connect And Sign-On step. The mouse pointer changes to 
a plus (+) sign. 


Click and drag the step to the top row. 


ES' Details | Design Steps Test Script Attachments | & Reqs Coverage 


aM Call Connect And 
Sign-On 


Display the Cruise 
Special page 


Display the Cruise 
Reservation page 


Book the cruise 


Print cruise 
confirmation. 


Call Connect And Sign-On with the following 
parameters: 


mercury tours url='hitrey ficarcininteirsfindey html! 


Click the Cruises button. 

Click the Now Accepting Reservations button. 
Enter passenger name, credit card information, and 
address. Click OK. 


Click the Print button. 


Click the Sign-Off button. 


The Cruise Special page opens. 


The Cruise Reservation page opens. 


The Cruise Confirmation page opens. 


A confirmation page is printed. 


Logs the user off. 
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Creating Requirements Coverage 


It is essential that the tests in your test plan comply with your testing 
requirements. To help ensure compliance throughout the testing process, 
you can add links between your tests and requirements from the Test Plan 
module and from the Requirements module. 


In the Test Plan module, you create requirements coverage by selecting 
requirements to link to a test. Alternatively, in the Requirements module, 
you create tests coverage by selecting tests to link to a requirement. A test can 
cover more than one requirement, and a requirement can be covered by 
more than one test. 


To further ensure compliance with your testing requirements, you can link 
your tests to defects (you will do so, in “Associating Defects with Tests” on 
page 86). This helps you ensure that if a testing requirement changes, you 
can immediately identify which tests and defects are affected, and who is 
responsible. 


In the following exercises, you will create requirements coverage and tests 
coverage. 


Linking Requirements to a Test 


In the following exercise you will create requirements coverage by linking 
the Cruise Booking requirement to the Cruise Booking test. 


To link a requirement to a test: 
1 Display the Test Plan module. 

Click the Test Plan tab. 
2 Display the Cruise Booking test. 

Under the Cruise Reservation folder, select the Cruise Booking test. 
3 Display the Reqs Coverage tab. 

Click the Reqs Coverage tab. 
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Fx, Select Req 


Coverage 
grid 


Requirements 
tree 


XI 


4 Display the requirements tree. 
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Click the Select Req button to show the requirements tree on the right. 


E Details V58 Design Steps T Test Script T Attachments | Reqs Coverage 
: Ww | O Include Child Requirements into Test Coverage 


: &, Select Req 


$ 


i 


FPR Hee eB 
LE E EE E E E E E o @ 


Mercury Tours Application 
Cruise Reservation 
Application Security 
Application Client System 
Application Usability 
Application Performance 
Application Reliability 
Profile Management 
Booking System 

Flights Reservation Service 
Reservations Management 


5 Search for the Cruise Booking requirement in the requirements tree. 


In the Find box, type Cruise Booking, and click the Find button. TestDirector 


highlights the requirement in the tree. 
6 Add the requirement to the coverage grid. 


Click the Add to Coverage button. The Cruise Booking requirement is 


added to the coverage grid. 


Tip: You can also drag a requirement or requirement topic in the 


requirements tree to the coverage grid. 


7 Hide the requirements tree. 


Click the Close button. 
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Linking Tests to a Requirement 


In the following exercise, you will create tests coverage by linking the Cruise 
Search test to the Cruise Booking requirement. 


To link a test to a requirement: 
Display the Requirements module. 
Click the Requirements tab. 


Display the requirement tree in Coverage View. 


Select the Coverage View of the requirement tree. 


4 Project : TestDirector_Demo [michae 


Requirements View Tools Analysis 


Document View Ba 


a- Xis- Mle- Alh dwg 
4. Cover Status ©aa ReqiD 
+ @ Mercury Tours Application X Failed (R@0003) 
+] @ Cruise Reservation ? Not Covered [RQ0140] 


The Test Coverage tab is displayed. 

Display the Cruise Booking requirement. 

In the requirement tree, select the Cruise Booking requirement. 
Display the test plan tree. 


In the Test Coverage tab, click the Select Tests button to show the test plan 
tree on the right. 


Select the Cruise Booking test in the test plan tree. 
Expand the Cruise Reservation sub-folder located in the Cruises folder. 


Select the Cruise Search test. 
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6 Add the test to the coverage grid. 


Click the Add to Coverage button. The Cruise Search test is added to the 
coverage grid. The coverage grid lists the tests that cover the selected 


requirement. 


E Tests Coverage TES" Details | Attachments 


i Ep Select Tests W | Status Filter: All ~ |O FullCoverage |. £3 Oo 8A x 
| [name [| status] Execution ete | Designer If» Stvect 
1 Cruise Booking  }™ No Run michael_te ie tues el 


+ 


(9 Compiled Modules 

A Cruises 

(9 Cruise Cancellation 

Cruise Reservation 
xè Cruise Booking 
X Cruise Search 

(9 Flight Reservation 

E ttinerary 

E Mercury Tours Site 

E Profiling 


|} Cruise Search = NoRun 9/3/2001 9:37:07 AM —michael_ta 


D-E 


) EF) 


In the above example, the coverage grid indicates that the Cruise Booking 
and the Cruise Search tests provide coverage for the Cruise Booking 
requirement. 


lye Tip: You can also drag a test or a subject folder in the test plan tree to the 
—\ coverage grid. 


7 Hide the test plan tree. 
X Click the Close button. 
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Generating Automated Test Templates 


Test planning involves deciding which tests to automate. If you choose to 
perform tests manually, the tests are ready for execution as soon as you 
define the test steps. If you choose to automate tests, you can generate test 
templates and complete them using other Mercury Interactive testing tools 
(for example, WinRunner, QuickTest Professional, or Astra QuickTest). 


Consider the following issues when deciding whether to automate a test. 


Do automate: e Tests that will run with each new version of your 
application to check the stability of basic 
functionality across the entire application 
(regression test). 


e Tests that use multiple data values for the same 
operation (data-driven tests). 


e Tests that are run many times (stress tests) and tests 
that check a multi-user client/server system (load 
tests). 


Do not automate: e Tests that will be executed only once. 
e Tests that require immediate execution. 


e Tests that check how easy the application is to use 
(usability tests). 


e Tests that do not have predictable results. 


In the following exercise, you will generate an automated test template for 
the Cruise Search test. 
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To generate an automated test template: 

Display the Test Plan module. 

Click the Test Plan tab. 

Locate the manual test that you want to automate. 


To find the test in the test plan tree, select the Subject folder and click the 
Find Folder/Test button. The Find Folder/Test dialog box opens. 


Find Folder/T est x] 
Find in: [Subject | 


CO Include Tests 


In the Value to Find box, type Cruise. 


Check Include Tests to instruct TestDirector to search for folders and tests. 


Click Find. The Search Results dialog box opens and displays a list of 
possible matches. 


Select Cruises\Cruise Reservation \Cruise Search, and click the Go To button 
to highlight the test in the test plan tree. 


Click Close to the close the Search Results dialog box. 
Display the Design Steps tab. 

Click the Design Steps tab. 

Generate a test template. 

Click the Generate Script button. 


Choose WR-AUTOMATED to generate a WinRunner test type, or choose 
QUICKTEST-TEST to generate QuickTest Professional or Astra QuickTest test. 
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Note: The QUICKTEST-TEST test type is only available if you have installed 
the QuickTest Professional/Astra QuickTest add-in from the TestDirector 
Add-ins page. For more information on installing the add-in, see the 
TestDirector Installation Guide. 


The Test Plan module uses the steps of the Cruise Search test to create an 
automated test template. In the test plan tree, note that the manual test 
icon M® next to the test is now replaced with the automated test icon. 


View the test template. 
Click the Test Script tab. 


To display your test template in the testing tool in which it was created, 
click the Launch button. You can now modify your test. 


Now that you are familiar with creating a test plan tree, designing test steps, 
copying test steps, calling a test with parameters, linking tests to 
requirements, and automating your manual tests, you can proceed to 
Lesson 4, “Running Tests”. In Lesson 4, you will learn how to run your 
manual and automated tests. 


4 


Running Tests 


I 


YYY VYVY 


Running tests is the core of the testing process. As your application changes, 
you run the manual and automated tests in your project in order to locate 
defects and assess quality. 


You start by creating test sets and choosing which tests to include in each set. 
A test set is a group of tests in a TestDirector project database designed to 
achieve specific testing goals. TestDirector enables you to control the 
execution of tests in a test set. You can set conditions, and schedule the date 
and time for executing your tests. 


Once you have defined test sets, you can begin executing your tests. When 
you run a test manually, you execute the test steps you defined in test 
planning. You pass or fail each step, depending on whether the application’s 
actual results match the expected output. When you run a test 
automatically, TestDirector opens the selected testing tool, runs the test, and 
exports the test results to TestDirector. 


In this lesson, you will learn about: 
Defining Test Sets 

Adding Tests to a Test Set 
Scheduling Test Runs 

Running Tests Manually 


Running Tests Automatically 
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Defining Test Sets 


You can organize test runs by building test sets. You build test sets by 
selecting automated and/or manual tests from the test plan tree. Note that 
you can include the same tests in different test sets. When you run the tests, 
results are stored separately for the different test instances. 


To decide which test sets to create, think about the testing goals you defined 
at the beginning of the testing process. Following are examples of general 
categories of test sets you could create: 


Test Set Description 


Sanity Tests the entire application at a basic level to check that it is 
functional and stable. 


Normal Tests the system in a more in-depth manner than the sanity test. 
A Normal test set can contain both positive and negative checks. 
Positive checks test that the application responds to input as 

expected. Negative tests attempt to crash an application in order 
to demonstrate that the application is not functioning properly. 


Advanced Checks the entire application, including its most advanced 
features. 
Regression Verifies that a change to one part of the application did not 


prevent the rest of the application from functioning. 


Function Tests a specific feature or a group of features in the application. 


In the following exercise, you will define the Mercury Tours Demo test set. 
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To define a test set: 
Open the TestDirector_Demo project. 


If the TestDirector_Demo project is not already open, log in to the project. 
For more information, see “Starting TestDirector,” on page 5. 


Display the Test Lab module. 
Click the Test Lab tab. 
Add a test set to the Test Sets list. 


Click the New Test Set button or choose Test Sets > New Test Set. The New 
Test Set dialog box opens. 


New Test Set xi 
Test Set Name: 
Description: 


In the Test Set Name box, type a name for the test set. For example, type: 
Mercury Tours Demo. 


In the Description box, type a description of the test set. For example, type: 
This test set includes tests that verify the functionality of the Mercury Tours site. 


Click OK. The Mercury Tours Demo test set is added to the Test Sets list in 
the left window pane. 
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4 Define the test set details. 


Click the Test Set Properties tab and select the Details link. 


Execution Grid Y Execution Flow TES} Test Set Propertics [Itt 


Test Set Information 


ay 


Notifications 
Description: 


On Failure The test set includes tests that verify the functionality of the Mercury Tours site. 


Attachments 


Details 


Status: Open Date: [6/18/2002 [F] 


Other Information 


By default, the Status indicates that the test set is Open. 


In the Open Date box, select a date from the calendar. By default, 
TestDirector displays the current date. 


In the Close Date box, select the planned closing date for the test set. 


For the purpose of this exercise, skip the following fields: Level, Version, and 
Project. 


Display the test set attachments. 


Click the Attachments link. You can add an attachment to the test set. An 
attachment can be a file, URL, snapshot of your application, an image from 
the Clipboard, or system information. For the purpose of this exercise, skip 
this option. 
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6 Set rules for the automated tests in the test set in the event of a test 
failure. 


Click the On Failure link. 


Execution Grid T(R Execution Flow EG} Test Set Propertics [II 


On automated test failure 


m| 


Notifications If an automated test fails, rerun the test up to |! H times 
On Failure O Run cleanup test krone» g before each rerun of the test 
Attachments Settings per test... 
On final test failure 
Details On the final failure of any test in the test set 
@ Do nothing 


© Stop the test set 


© Rerun the test set 
Maximal number of times the test set can be rerun is |1 =| 


Select the first check box to set the test set on failure rule. Make sure that the 
number of times an automated test should be rerun is set to 1. 


The second check box enables you to include a clean up test from the test 
plan tree. For the purpose of this exercise, skip this option. 

The Settings per test link enables you to change the above on failure rules 
for any test in the test set. For the purpose of this exercise, skip this option. 


In On final test failure, you can instruct TestDirector, after the final test 
failure, to do nothing, stop the test set, or run the test set again a specified 
number of times. Make sure that the Do nothing option is selected. 
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7 Instruct TestDirector to send an e-mail to specified users if certain 
events occur. 


Click the Notifications link. 


"EQ Execution Grid YQ Execution Flow 


Select the first check box to send a notification if any test in the test set fails. 


To specify who should receive the e-mail, type your actual e-mail address in 
the To box. 


In the Message box, type a message for the e-mail. For example, type: This 
test failed. Please review the test results and submit a defect. 
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Adding Tests to a Test Set 


[Ta, Select Tests 


Once you have defined a test set, you can add copies of tests from the 
project to your test set. In the following exercise, you will add tests to the 
Mercury Tours Demo test set. 


To add a test to a test set: 

Display the Test Lab module. 

Click the Test Lab tab. 

Display the Execution Grid tab. 

Select the Mercury Tours Demo test set from the Test Sets list. 
Click the Execution Grid tab. 

Display the test plan tree. 


Click the Select Tests button. The right window pane displays the test plan 
tree. 


Execution TestSets View Hosts Analysis 


Test Sets Execution Grid | (@ Execution Flow D Test Set Properties Test Plan Tree 


EE — A 


Sorted By: Test Set[Asc]; $ 
? 
seraut i Compie Mod 
+) 

> Mercury Tours Demo aS chee gi 
Mercury Tours Functionality ap E Flight Reservation 
Mercury Tours Loading (© ttinerary 
Mercury Tours Sanity H-E Mercury Tours Site 
Mercury Tours Ul H-E Profiling 
Performance Under Load 


T Last Run Result 
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4 Add the Cruises folder to the test set. 


Select the Cruises folder, and click the Add Tests to Test Set button. 


The Parameter dialog box opens if a test that you are adding to a test set has 
an unassigned parameter value. You can assign a value now, or later when 
you run the test. For the purpose of this exercise, click OK to close this 
dialog box. You will assign this parameter value when you run the Cruise 
Booking test (see “Running Tests Manually” on page 61). 


TestDirector adds all the tests in the folder to the test set. 


Add the Airline Preference test to the test set. 


To search for the test, type Airline in the Find box, and click the Find button. 
TestDirector highlights the Airline Preference test in the test plan tree. 


Click the Add Tests to Test Set button. TestDirector adds the test to the test 
set. 


Add the Number of Passengers test to the test set. 


To search for the test, type Number of Passengers in the Find box, and click 
the Find button. TestDirector highlights the test in the test plan tree. 


Click the Add Tests to Test Set button. TestDirector adds the test to the test 
set. 


Tip: You can also add tests by dragging a folder or test in the test plan tree to 
the Execution Grid or Execution Flow. 


Close the test plan tree window pane. 


Click the Close button. 
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Scheduling Test Runs 


You can specify a date and time, and set conditions for executing a test in 
the Execution Flow tab. A condition is based on the results of another 
specified test in the Execution Flow. By setting conditions, you can instruct 
TestDirector to postpone execution of the current test until the other 
specified test has either finished running or passed. You can also set the 
sequence in which to execute the tests. 


For example, suppose you schedule to run Test 2 only after Test 1 has 
finished, and run Test 3 only if Test 2 passed. You can also schedule Test 1 
and Test 2 to run a day before Test 3. Unlike the Execution Grid, which 
displays the tests with only test run information, the Execution Flow 
displays the tests with conditions in a diagram. 


E Execution Grid R Execution Flow [ES Test Set Properties 


- [E$ Select Tests > Run 7 4%. Run Test Set | p2 Y | dds | P P E 5 Q 

az 

Demo 

811712002 ~~ 
3 1 
eer 
8/18/2002 "G 

F 

[1]Test 3 
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A dashed line —- —— — arrow indicates a test with no conditions. A solid 
line —————— arrow indicates a condition and can be blue or green. If the 
solid line is blue, it indicates that the condition status is set to “Finished”. If 
the solid line is green, it indicates that the condition is set to “Passed”. 
When a test is time-dependent, a Time Dependency @ icon is added to the 
diagram. 


In the following exercise, you will create a new test set, and add to it three 
tests that verify the login procedure on the Sign-On page of the Mercury 
Tours site. Then, you specify under what conditions you want to run each 
test and when. 


To schedule a test run: 

Create a test set for this exercise. 

In the Test Lab module, click the Execution Flow tab. 

Click the New Test Set button. The New Test Set dialog box opens. 
In the Test Set Name box, type: Test Run Schedule. 


In the Description box, type: This test set is used to explain how to schedule a 
test run. 


Click OK. The Test Run Schedule test set is added to the Test Sets list in the 
left window pane, and the right window pane displays the test plan tree. 


Add tests from the Sign-On/Sign-Off folder to the Test Run Schedule test 
set. 


To search for the Sign-On/Sign-Off folder , type Sign in the Find box, and 
click the Find button. TestDirector highlights the Sign-On/Sign-Off folder in 
the test plan tree. 


Select the Sign-On Page test. Click the Add Tests to Test Set button. 
TestDirector adds the test to the test set. 


Drag the Sign-On User Name test to the Execution Flow area. 


Lesson 4 è Running Tests 
Drag the Sign-On Password test to the Execution Flow area. 


E Execution Grid RA Execution Flow (Ss Test Set Properties (pa Lens 


i [ER Select Tests b Run + 44 Run Test Set | 2 W |ia | PP B-l@ 
aj 
Test Run Schedule 
yr | s 
A Pi ia EN 
£ Y ™ 
ut mè ue 
[1]Sign-On Page [1]Sign-On User Name [1]Sign-On Password 


3 Add an execution condition to the Sign-On User Name test. 


Right-click the Sign-On User Name test and choose Test Run Schedule. The 


Run Schedule of Test dialog box opens and displays the Execution 
Conditions tab. 


Run Schedule of Test <[1]Sign-On User Name> xi 


Executon Conditions | Time Dependency 


Test Has No Execution Conditions 
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Click New. The New Execution Condition dialog box opens. 


New Execution Condition Ea 


Test <[1]Sign-On User Name> runs only if 


Fristed 


Comments 


In the Test box, select Sign-On Page. 


Select Passed to instruct that the Sign-On User Name be executed only if the 
Sign-On Page test has finished executing and passed. 


Click OK. The condition is added to the Run Schedule of Test dialog box. 


Executon Conditions | Time Dependency 
Test Runs Only If 


ae [1]Sign-OnPa is Passed 
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4 Add a time dependency condition to the Sign-On User Name test. 
Click the Time Dependency tab. 


Run Schedule of Test <[1]Sign-On User Name> xi 


Executon Conditions | Time Dependency 


© Run &t Specified Time 


O Date 6/20/2002 


Time 6:08:43 PM 


Select Run At Specified Time, and select tomorrow’s date from the Date box. 


Click OK to close the Run Schedule of Test dialog box. Your conditions are 
displayed in the Execution flow diagram. 


EB Execution Grid | (Q Execution Flow | ES! Test Set Properties 


i [Eh Select Tests DP Run ~ $$ Run Test Set | P W | la | e P wH-\@ 
a 
Test Run Schedule 
an ~~ 
a @ es 
a 6/20/2002 PH as 


so A 


mè K nt ut 
[1]Sign-On Page [1]Sign-On User Name [1]Sign-On Password 
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5 Add an execution condition to the Sign-On Password test. 


Add the same execution condition as described in Step 3 on page 57 for the 
Sign-On Password test. This time select Sign-On User Name from the Test 
box in the New Execution Condition dialog box. 


Add a time dependency condition to the Sign-On Password test. 


Add the same execution condition as described in Step 4 on page 59 for the 
Sign-On Password test. 


Click OK to close the Run Schedule of Test dialog box. Your conditions are 
displayed in the Execution flow diagram. 


E Execution Grid fee) Execution Flow ey Test Set Properties 


: E Select Tests DB Run + 4%, Run Test Set | E y |ia | 2 P H- @Q 
az 
Test Run Schedule 
Pad 
we 
= 612012002 
ut —> 1è o 
[1]Sign-On Page [1]Sign-On User Name [1]Sign-On Password 
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7 Rearrange the tests in a hierarchical layout. 


To clearly view dependencies between different tests, click the Arrange Tests 
Sequentially button. 


E Execution Grid @ Execution Flow Es Test Set Properties 


: E Select Tests DB Run + 4%, Run Test Set | 2 W | dds | © e uo Q 


ai 


Test Run Schedule 


v 


m 
[1]Sign-On Page 


Q 


6/20/2002 ae 


me 
[1] Sign-On User Name 


m 
[1] Sign-On Password 


Running Tests Manually 


When you run a test manually, you follow the test steps and perform 
operations on your application. You compare the expected results with the 
actual outcome and record the results. You can execute a test as many times 
as you want. Test results are stored separately for each run. 


Note that you can run both manual and automated tests manually. You can 
choose to run a single test or run an entire test set. 


In the following exercise, you will run the Cruise Booking test. 
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To run a test manually: 
1 Display the Test Lab module. 

Click the Test Lab tab. 
2 Select the Mercury Tours Demo test set. 

In the Test Sets list, select the Mercury Tours Demo test set. 
3 Select the Cruise Booking test from the Execution Grid. 


In the Execution Grid tab, select the Cruise Booking test. 


Click the Run button. The Manual Runner dialog box opens. 


‘i Manual Runner Test Set: <Mercury Tours Demo> Test: <[1]Cruise Booking> Eg 


Run Details 


Run Name: Run_6-19_15-10-49 Operating System Info 
Tester Name: michael_td M 


Status: Not Completed 


Exec Date: 


Exec Time: 3:10:50 PM 


Test Details 


Name: Cruise Booking More... 


| 


62 


Lesson 4 œ Running Tests 


Under Run Details, you can view and modify test run details. In the Test 
Details box, you can view a description of the test that you are running. 


4 Start the test run. 


Click the Exec Steps button. 


Because the test that you are running has one unassigned parameter, the 
Parameters dialog box opens, enabling you to assign a value. 


Run_6-19_15-45-19 Eg 
Name ae S 


password 


5 Assign a value for the password parameter. 


Click the Value box for the password parameter, and type mercury (this is the 
the same password as the one used in “The Mercury Tours Sample Web Site” 
on page 10). 
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Click OK. The Manual Runner: Step Details dialog box opens. 


<i Manual Runner Test Set: <Mercury Tours Demo> Test: <[1]Cruise Booking> 
x] [vl xt pneron [1 a 


TET Tours Site ‘Connect 6419/2002 3:48:34 PM 
Sign-On to Mercury ° Sign-On 6419/2002 3:48:34 PM 
Display the Cruise S| Cruise Booking ‘6A 9/2002 3:48:34 PM 
Display the Cruise Ri Cruise Booking 6419/2002 3:48:34 PM 
Book the Cruise Cruise Booking 6419/2002 3:48:34 PM 
Print cruise confirma Cruise Booking 6419/2002 3:48:34 PM 
Log off (Cruise Booking 6419/2002 3:48:34 PM 


Descriptio 
Open your Web browser and type the «Mercury Tours URL». 


The Mercury Tours site opens. 
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6 Display the Manual Runner dialog box in a compact view. 


To conveniently read each test step and record the results using the compact 
view display of this dialog box, click the Compact View button. 


al | vil x PBI | «>| le 


(147) Step: | Connect to Mercury Tours 
6/24/2002 4:56:00 PM 


Description: 


Open your Web browser and type the — 
«Mercury Tours URL». 


Expected Result: 


The Mercury Tours site opens. a 


Actual Result: 


a 


7 Perform the first step. 


Perform the procedure described in the Description box. 


If the actual result is the same as the expected result, in the Actual box, type: 
The Mercury Tours site opens. 


Click the Passed button. TestDirector adds a green check to the step and 
changes the step status to Passed. 


Perform the second step. 
Perform the procedure described in the Description box. 


If the actual result is the same as the expected result, in the Actual box, type: 
The Flight Finder page opens. 


Click the Passed button. TestDirector adds a green check to the step and 
changes the step status to Passed. 


65 


TestDirector Tutorial 


66 


9 
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Perform the third step. 
Perform the procedure described in the Description box. 


If the actual result is the same as the expected result, in the Actual box, type: 
The Cruise Special page opens. 


Click the Passed button. TestDirector adds a green check to the step and 
changes the step status to Passed. 


Perform the fourth step. 
Perform the procedure described in the Description box. 


If the actual result is different than the expected result, in the Actual box, 
type: The Flight Finder page opens instead of the Cruise Reservation page. 


Click the Failed button. TestDirector adds a red X to the step and changes 
the step status to Failed. 


Note that when you detect an application flaw while running the test, you 
can click the Add Defect button to open the Add Defect dialog box and add 
a defect. For the purpose of this exercise, you will submit this defect in 
“Adding New Defects,” on page 77. 


Return to the default display of the Manual Runner. 


Click the Back to Steps Grid button. The default display of the Manual 
Runner: Step Details dialog box is displayed. 


End the test run. 


Click the End of Run button to end your test run. 
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13 View the test run results in the Execution Grid. 


Following the execution of your test, you can view the test run results of 
your last run in the Execution Grid. Note that the status for the test run is 
updated from “No Run” to “Failed”. 


E Execution Grid | (2 Execution Flow (E Test Set Properties 


[T Select Tests > Run 7 a4. Run Test Set y K 


— a 


Bum [1 Cruise Booking 

fi [1]Cruise Search AR- -AUTOMATED ® No Run 
th [1]Cancel All Reservations WR-AUTOMATED ® No Run 
ie [1]Airline Preference WR-AUTOMATED » No Run 
>] [1] Number Of Passengers QUICKTEST_TEST = No Run 


14 View the results of each test step in the Last Run Results pane. 


If the Last Run Result pane is not displayed, click View > Last Run Result. 
The Last Run Result pane is displayed below the Execution Grid. 


4 Last Run Result 
Description: 
ect to Mercury ` p7 Passed 5/24/2002 Open your Web browser and type the «Mercury Tours URL». 
| [Sign-On to Mercury 14” Passed 6/24/2002 
| [Display the Cruise Sk V? Passed 6/24/2002 


| [Display the Cruise Red Failed 6124/2002 Actual: 
S The Mercury Afi The Mercury Tours site opens. 


| [Book the Cruise ® No Run 6/24/2002 
| [Print cruise confirmal ® No Run 6/24/2002 
® No Run 6/24/2002 


Tours site opens. 


Click each step in the Last Run Result pane to view the step’s description, as 
well as the expected and actual results. 


Note that you can view more detailed results in the Test Run Properties 
dialog box (see “Running Tests Automatically” on page 68). 
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Running Tests Automatically 


68 


When you run an automated test, TestDirector opens the selected testing 
tool automatically, runs the test on your local machine or on remote hosts, 
and exports the results to TestDirector. 


Note that you can run all tests in a test set or run specific tests. You can run 
tests from the Execution Grid tab or the Execution Flow tab. 


In the following exercise, you will run an automated test from the Mercury 
Tours Demo test set. After the test run is complete, you will view the test 
results from the Test Run Properties dialog box. 


Note: To perform the following exercise, you must have one of the 
following tools installed on your computer: 


> WinRunner 7.01 or higher 
> QuickTest Professional 5.6 or higher 
> Astra QuickTest 5.6 or higher 


To launch QuickTest Professional or Astra QuickTest from TestDirector, you 
must also install the QuickTest Professional/Astra QuickTest add-in from the 
TestDirector Add-ins page. Note that in certain cases, you must also install 
the TestDirector Connectivity add-in. For more information on installing 
the add-ins, see the TestDirector Installation Guide. 


To run a test automatically: 

Display the Mercury Tours Demo test set in the Execution Grid. 
Click the Test Lab tab. 

Click the Execution Grid tab. 


Select the Mercury Tours Demo test set from the Test Sets list. 


Run 
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2 Select a test. 
To run a WinRunner test, select the Airline Preference test. 


To run a QuickTest Professional or Astra QuickTest test, select the Number of 
Passengers test. 


Click the Run button, or choose Execution > Run. The Execution dialog box 
opens and displays the selected test. 


:# Execution of <Mercury Tours Demo> lolx] 
Run Settings 


= 
È Run All| im Run # Stop | 


3 Set the test run settings. 


Select the Run All Tests Locally check box to run the test on your local 
computer. 


You can instruct TestDirector to create an execution log file during the test 
run. For the purpose of this exercise, ignore the Enable Log option. 
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4 Run the test. 
Click Run. 


TestDirector opens the selected testing tool automatically and runs the test. 
You view the test execution progress in the Status column. 


‘fi Execution of <Mercury Tours Demo> BEIEG 
Run Settings 


5 Close the Execution dialog box. 


After the test run is complete, click Close. 
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6 View a summary of test results in the Execution Grid tab. 


The updated status for the test run appears in the Execution Grid tab. 
Results for each test step appear in the Last Run Results pane. 


E Execution Grid È Execution Flow E Test Set Properties 


- [FR Select Tests > Run ~ 4% Run Test Set | YY 


H e| w 


- = oe 


wè [1]Cruise Booking 

fie (1]Cruise Search 

lic [1]Cancel All Reservations 
[1]Airline Preference 

By [1]Number Of Passengers 


iteration passed 
iteration passed 
Iteration passed 
iteration passed 
iteration passed 


v? Passed 
ov Passed 
v? Passed 
y Passed 
v Passed 


MANUAL X Failed 

WR-AUTOMATED > No Run 
WR-AUTOMATED | > No Run 
WR-ASUTOMATED W° Passed 
QUICKTEST_TEST No Run 


6/24/2002 
6/24/2002 
6/24/2002 
6/24/2002 
6/24/2002 


Run: Run_6-24_ 10-30-22 


All preferences work properly for the flight from New York to Zurich 
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7 View detailed test results from the Test Run Properties dialog box. 


Make sure your test is selected in the Execution Grid. Click the Test Run 
Properties button. The Test Run Properties dialog box opens and displays 
the All Runs tab. 


& Test Run Properties Eg 
Test: [1]Airline Preference a a ee (2) 


6-24 10-30-22 yf Passed CARGO 447 6/24/2002 10:38:21 AM  michael_td 


=== 
| _|StepName [Status ||) Run: Run_6-24_10-30-22 
| | ¥ Passed E 

¥ Passed 

v? Passed 

¥ Passed 

¥ Passed 


All preferences work properly for the flight from New York to Zurich 


8 View the results in the All Runs tab. 


TestDirector lets you compare the results of a test run with the results of 


previous runs. You can view run details and step results for all the runs of a 
selected test. 
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9 View the test results in your selected testing tool. 


= View Report 


Di Launch Report 


> To view the test results in WinRunner, click the View Report button in 
the All Runs tab. The WinRunner Test Results window opens. 


Choose File > Exit to close the WinRunner Test Results Window. 


> To view the test results in QuickTest Professional or Astra QuickTest, click 
the Launch Report button in the All Runs tab. The Test Results window 
opens. 


Choose File > Exit to close the Test Results Window. 


10 View other test run information in the Test Run Properties dialog box. 
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> To view run details of a test, click the Details tab. 
> To view any attachments to a test, click the Attachment tab. 


> To view the test parameters, click the Run Configuration tab. This tab also 
enables you to set parameters for a manual test or a WinRunner test. 
Note that any changes that you make will be implemented in the next 
test run. 


> To view the rules in the event that the test fails, click the Run Events tab. 
This tab also enables you to change your rules. Note that any changes 
that you make will be implemented in the next test run. 


» To view a list of changes made to the test run field, click the History tab. 
Close the Test Run Properties dialog box. 

Click Close. 

Close your selected testing tool. 

In WinRunner, choose File > Exit. 

In QuickTest Professional or Astra QuickTest, choose File > Exit. 

Now that you are familiar with how to define and build test tests, schedule 
test runs, and run tests manually or automatically, you can proceed to 


Lesson 5, “Adding and Tracking Defects”. In Lesson 5, you will learn how to 
add and track defects. 
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Adding and Tracking Defects 


LEF 
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Locating and repairing defects is an essential phase in application 
development. Defects can be detected and reported by developers, testers, 
and end users in all stages of the testing process. Using TestDirector, you can 
report defects detected in the application, and track them until they are 
repaired. 


In this lesson, you will learn about: 


How to Track Defects 

Adding New Defects 
Matching Defects 

Updating Defects 

Mailing Defects 

Associating Defects with Tests 


Creating Favorite Views 
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How to Track Defects 


When you report a defect to a TestDirector project, it is tracked through the 
following stages: New, Open, Fixed, and Closed. A defect may also be Rejected, 
or Reopened after it is fixed. 


New 


Open 


Fixed 


Closed 


no 


When you initially report the defect to the TestDirector project, by default it 
is assigned the status New. A quality assurance or project manager reviews 
the defect, and determines whether or not to consider the defect for repair. 
If the defect is refused, it is assigned the status Rejected. If the defect is 
accepted, the quality assurance or project manager determines a repair 
priority, changes its status to Open, and assigns it to a member of the 
development team. A developer repairs the defect and assigns it the status 
Fixed. You retest the application, making sure that the defect does not recur. 


If the defect recurs, the quality assurance or project manager assigns it the 
status Reopened. If the defect is actually repaired, it is assigned the status 
Closed. 
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Adding New Defects 


You can add a new defect to a TestDirector project at any stage of the testing 
process. In the following exercise you will report the defect that was 
detected while running the Cruise Booking test. 


To add a new defect: 
1 Open the TestDirector_Demo project. 


If the TestDirector_Demo project is not already open, log in to the project. 
For more information, see “Starting TestDirector,” on page 5. 


2 Display the Defects module. 


Click the Defects tab. The Defects Grid displays defect data in a grid. Each 
line in the grid displays a separate defect record. 
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3 Open the Add Defect dialog box. 


Click the Add Defect button. The Add Defect dialog box opens. Note that 
fields that are marked in red are mandatory. 


| E Clear attach: £0 & a © a|s v m 


Defect Information: 


* Detected By: [aice ta [~] * Detected on Date: [05/23/2002 + | 
* Project: [Mercury Tours (HT |>] *Detected in Version [ M 


Description 


4 Summarize the defect. 


In the Summary box, type a brief description of the defect. For example, 
type: Unable to reserve a cruise from the Cruise page. 
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5 Specify the defect information. 


In Category, specify the class category of the defect. Select Defect. 


Skip the Detected By box. This field indicates the name of the person who 
detected the defect. By default, the login user name is displayed. 


Skip the Project box. This field indicates the name of the project in which 
this defect was found. Accept the default value. 


In Severity, specify the severity level of the defect. Select 2-Medium. 


Skip the Reproducible box. This field indicates whether the defect can be 
reproduced under the same conditions in which it was detected. Accept the 
default value. 


In Subject, specify the subject in the test plan tree to which the defect is 
related. Select Cruises. 


Skip the Detected on Date box. This field indicates the date on which the 
defect was found. By default, today’s date is displayed. 


In Detected in Version, specify the application version in which the defect 
was detected. Select Version 1.01. 


Skip the Status box. When you initially add a defect to a project, it is 
assigned the status New. 


Skip the Regression field. Accept the default value. 
Skip the user-defined fields. 


Click the Next Page arrow. For the purpose of this exercise, skip the 
following fields: Language, Browser, and Operating System. 


Click the Back Page arrow. 
Type a detailed description of the defect. 


In the Description box, type a description of the defect. For example, type: 
The defect was detected in the Cruise Booking test. When you click the Now 
Accepting Reservations button, the Flight Finder page opens instead of the 
Cruise Reservation page. 
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8 Attach the URL address for the Mercury Tours page where the defect was 


detected. 
Click the Attach URL button. The Attach URL dialog box opens. 


Type the URL address of the Mercury Tours page. For example, type: 
http://[server name]/mtours/servlet/com.mercurytours.servlet.ReservationServlet 


Make sure to replace [server name] with your actual TestDirector server 
name. 


Click OK. The URL appears above the Description box. 
Spell check your text. 


Place the cursor in the Description box, and click the Check Spelling button. 
If there are no errors, a confirmation message box opens. If errors are found, 
the Spelling dialog box opens and displays the word together with 
replacement suggestions. 


10 Add the defect to the TestDirector project. 
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Click the Submit button. A confirmation message box indicates that the 
defect was added successfully. Click OK. 


Close the Add Defect dialog box. 
Click Close. The defect is listed in the Defects Grid. 


Matching Defects 
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Matching defects enables you to eliminate duplicate or similar defects in 
your project. Each time you add a new defect, TestDirector stores lists of 
keywords from the Summary and Description fields. When you search for 
similar defects, keywords in these fields are matched against other defects. 


Note that keywords are more than two characters, and letter case does not 
affect your results. TestDirector ignores the following: articles (a, an, the); 
coordinate conjunctions (and, but, for, nor, or); boolean operators (and, or, 
not, if, or then); and wildcards (?, *, [ ]). 


In the following exercise, you will match defects by comparing a selected 
defect with all other existing defects in the TestDirector_Demo project. 


Lesson 5 ¢ Adding and Tracking Defects 


To match defects: 
1 Display the Defects module. 
Click the Defects tab. 
2 Select defect number 37. 
In the Defects Grid, select defect number 37. 


Note that if you cannot find defect number 37 in the Defects Grid, you will 
need to clear the filter that was applied to the grid. To do so, click the Clear 
Filter/Sort button. 


3 Find similar defects. 
Click the Find Similar Defects button. 
Al 


Results are displayed in the Similar Defects dialog box. Similar defects are 
displayed according to the percentage of detected similarity. 


| [DetectiD]status [Summary O 
| > 


The list of available flights is not given, when Departing and Returning dates are the 48% 
The list of flights is given when Departing date after Returning 40% 
All flight are shown when time preference is set to NOON 50% 
Clicking on Back to Home button opens Find Flight page 44% 
Cancel All Reservation button is available when there are no reservations 40% 
There is no confirmation message on Cancel Reservations 40% 


Description 


Step: Step 2: Same Departing and Returning Date 


R&D Comments 
QA Tester <alice_td>, 09/17/2001: Now the list of flights is given, but Retuming flight time precedes the Departing flight time. 


Click Close to close the Similar Defects dialog box. 
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Updating Defects 
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Tracking the repair of defects in a project requires that you periodically 
update defects. You can do so directly in the Defects Grid, or in the Defect 
Details dialog box. Note that the ability to update some defect fields 
depends on your permission settings as a user. 


In this exercise you will update your defect information. 


To update a defect: 

Display the Defects module. 

Click the Defects tab. 

Update the defect directly in the Defects Grid. 


In the Defects Grid, select the defect that was added in “Adding New 
Defects” on page 77. 


To assign the defect to a member of the development team, click the 
Assigned to box that corresponds to the defect and select james_td from the 
Assign to list. 


3 Open the Defect Details dialog box. 
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Click the Defect Details button. The Defect Details dialog box opens. 


Defect Details Eg 
Defect: Unable to reserve a cruise from the Cruise page a || <4 || > || 2 | 


ES" Details ©, Description ft] Attachments History 


< 


Planned 


Planned Closing Version: Lo H 


* Category: 

* Project: 

* Subject: 

* Reproducible: 
* Detected By: 
Assigned To: 


Defect * Status: 


Mercury Tours (HT I>] * Detected in Version: 


Cruises * Detected on Date: 


Version 1.01 
; 16/5/2002 


Regression: 


michael_td * Severity: 


Estimated Fix Time: [ | (Hours) 


Actual Fix Time: zz (Hours) 


4 Change the severity level of the defect. 


Select 5-Urgent from the Severity list. 


5 Add anew R&D comment to explain the change in the severity level. 


Click the Description tab. 


Click the Comment button. A new section is added to the RED Comment 
box, displaying your user name and the current date. 


Type: This defect also occurs in Mercury Tours version 1.0. 


6 View the Attachments. 


Click the Attachments tab. Note that the URL attachment is listed. 
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7 View the History. 


Click the History tab to view the history of changes made to the defect. For 
each changed field, the date of the change, the name of the person who 
made the change, and the new value are displayed. 


8 Close the Defect Details dialog box. 


Click OK to exit the dialog box and save your changes. 


Mailing Defects 
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You can send an e-mail about a defect to another user. This enables you to 
routinely inform development and quality assurance personnel about defect 
repair activity. 


In the following exercise, you will e-mail your defect. 


To mail a defect: 
1 Display the Defects module. 
Click the Defects tab. 


Lesson 5 ¢ Adding and Tracking Defects 


2 Select a defect. 


Select the defect you added in “Adding New Defects” on page 77, and click 
Ba the Mail Defects button. The Send Mail dialog box opens. 
Y 


v] 44 - Unable to reserve a cruise from the Cruise page 


Include: O Attachments O History 


Additional comments: 


E 


3 Type a valid e-mail address. 
In the To box, type your actual e-mail address. 
4 Type a subject for the e-mail. 
In the Subject box, type a subject for the e-mail. 
5 Include the attachments and history of the defect. 
In the Include box, select Attachments and History. 
6 E-mail the defect. 
Click Send. A message box opens. Click OK. 
7 View the e-mail. 


Open your mailbox and view the defect you sent. 
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Associating Defects with Tests 
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You can associate a test in your test plan with a specific defect in the Defects 
Grid. This is useful, for example, when a new test is created specifically for a 
known defect. By creating an association, you can determine if the test 
should be run based on the status of the defect. Note that any requirements 
covered by the test are also associated with the defect. 


You can also create an association during a manual test run, by adding a 
defect. TestDirector automatically creates an association between the test 
run and the new defect. 


In the following exercise, you will associate your defect with the Cruise 
Booking test in the Test Plan module, and view the associated test in the 
Defects Grid. 


To associate a defect with a test: 
Display the Test Plan module. 
Click the Test Plan tab. 

Select the Cruise Booking test. 


In the test plan tree, expand the Cruise Reservation sub-folder under 
Cruises. 


Right-click the Cruise Booking test in the test plan tree or Test Grid, and 
choose Associated Defects. 


bes Associate... 


Lesson 5 Ħ Adding and Tracking Defects 


The Associated Defects dialog box opens. 


Associated Defects Ea 


Description: 


R&D Comments: 


Add an associated defect. 


Click the Associate button. The Associate Defect dialog box opens. 


| Associate Defect 


Click the Select button to select your defect from a list of available defects. 
Click the Associate button. 


An information box opens. Click OK. 
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Click Close to close the list of available defects. Your defect is added to the 
list. 


Click Close to close the Associated Defects dialog box. 
View the associated test in the Defects Grid. 
Click the Defects tab. 


Select your defect in the Defects Grid, and choose View > Associated Test. 
The Associated Test dialog box opens. 


> The Details tab displays a description of the test. 
The Design Steps tab lists the test steps. 
The Test Script tab displays the test script if the test is automated. 


The Reqs Coverage tab displays the requirements covered by the test. 


VvvV Y 


The Test Run Details tab displays run details for the test. This tab is only 
available if the association was made during a test run. 


y 


The All Runs tab displays the results of all test runs and highlights the 
run from which the defect was submitted. This tab is only available if 
the association was made during a test run. 


Creating Favorite Views 
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A favorite view is a view of a TestDirector window with the settings you have 
applied to it. You can save favorite views of the Test Grid, Execution Grid, 
Defects Grid, and all TestDirector reports and graphs. For example, your 
favorite view settings may include applying a filter to grid columns, sorting 
fields in a report, or setting a graph appearance. 


In the following exercise, you will create a favorite view in the Defects Grid. 


To create a favorite view: 
Display the Defects module. 
Click the Defects tab. 
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2 Define a filter to view defects you detected that are not closed. 


Click the Set Filter/Sort button. The Filter dialog box opens. 


Click the Filter Condition box that corresponds to Detected By. Click the 
Browse button. The Select Filter Condition dialog box opens. 


Under Users, select your TestDirector login user name (alice_td, cecil_td, or 
michael_td). Click OK to close the Select Filter Condition dialog box. 
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Click the Filter Condition box that corresponds to Status. Click the Browse 
button. The Select Filter Condition dialog box opens. 


Select the logical expression Not. 


Select Closed. 


Condition : [Not Closed 


Click OK to close the Select Filter Condition dialog box. 


Click OK to close the Filter dialog box. The Defects Grid displays the defects 
you detected that are not closed. 


Add a favorite view. 


Click the Favorites button, and choose Add to Favorites. The Add Favorite 
dialog box opens. 


Add Favorite xi 


Location ®© Private © Public 


Existing Favorites 


In the Name box, type: My detected defects (status ‘Not Closed’). 


You can add a favorite view to either a public folder or a private folder. Views 
in the public folder are accessible to all users. Views in the private folder are 
accessible only to the person who created them. For the purpose of this 
exercise, select Private. 


| x 
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Click OK. The new view name is added to the Favorite list. 


Defects Search View Favorites Analysis 


on | Planned 


ug Verification 
lic: QA Team Member - My Fixed and Rejected Defects 
public: R&D Team Member - Defects Assigned to Me 


Not Closed 


| Reopen 3-High tmary_td michaeltd Email fields in Edit Profile form is empty, even if value was set di 9/2/2001 Version 1.01 
W Open 4Very High mary_td michaeltd Changes to Email field during editing profile are not saved 9/3/2001 Version 1.01 
O ya Open 2-Medium — james_td michaeltd User Name and Password fields have a different length on Wel 9/11/2001 Version 1.01 
| B Open 2-Medium — james_td michaeltd IMG tags have no WIDTH, HEIGHT and ALT attributes 9/11/2001 Version 1.01 
fe 25 Open 2-Medium james_td michaeltd User Name and Password fields are unlimited on Welcome pag: 9/11/2001 Version 1.01 
ome) 28 Open 1-Low peter_td michaeltd The default value of a Country list on the Registration page is U 9/15/2001 Version 1.01 
fe! Open 1-Low tmary_td michaeltd Country should be an Input field and not a List 9/15/2001 Future Versio. 
43 New michaeltd — All fields in Edit profile form are empty 10/25/2001 

o | 44 New james_td michaeltd Unable to reserve a cruise from the Cruise page 6/5/2002 


Now that you are familiar with how to add new defects, search for similar 


defects, update defects, e-mail defects, associate defects with tests, and create 
favorite views, you can proceed to Lesson 6, “Analyzing the Testing Process”. 
In Lesson 6, you will learn how to generate reports and graphs to help you 


analyze the testing process. 


91 


TestDirector Tutorial 


92 


6 


Analyzing the Testing Process 


TestDirector reports and graphs help you assess the progress of 
requirements, the test plan, test runs, and defect tracking. You can generate 
reports and graphs any time during the testing process from each 
TestDirector module, using default or customized settings. When 
customizing a report or graph, you can apply filters and sort conditions, and 
display information according to your specifications. You can also save your 
settings as favorite views and reload them as needed. 


D F In this lesson, you will learn about: 


> Generating Reports 


> Generating Graphs 


Generating Reports 


You can generate a report from any TestDirector module. Depending on the 
TestDirector module you are in, you have different report options. After you 
generate a report, you can customize report properties to display 
information according to your specifications. 


In the following exercise, you will generate a standard requirements report, 
customize the report for a specific user name, and add it to your favorites 
list. 
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To generate a report: 
Open the TestDirector_Demo project. 


If the TestDirector_Demo project is not already open, log in to the project. 
For more information, see “Starting TestDirector,” on page 5. 


Display the Requirements module. 


Click the Requirements tab. The Requirements module displays the 
requirements tree. 


Choose a report. 


Choose Analysis > Reports > Standard Requirements Report. The report 
opens with default data displayed. 


HELP 


+ Project : TestDirector_Demo [micha¢ TOOLS LOGOUT 
Requirements View Tools Analysis 
Requirements Analysis Standard Requirements Report 


his = 


a, 


> Reports 


Standard Requirements Re Requirements Report 


Ti 
RegID (3) - Mercury Tours Application 


Priority : 5-Urgent Product : Mercury Tours 

Type: Functional Attachment: 

Author : alex_td Cover Status : Failed 

Creation Date : 2001-01-09 Creation Time: 9:07:29 AM 

Name: Mercury Tours Application Modified : 2001-09-20 15:43:04 
RegID: 3 Planned Version : Version 1.0 
Reviewer : robert_td Reviewed : Reviewed 
Description : 


Web-based application (site) for travelers, 
ReqgID (4) - Online Travel Booking Services 


Priority : 5-Urgent Product : Mercury Tours 

Type: Functional Attachment: 

Author : alex_td Cover Status : Failed 

Creation Date : 2001-01-09 Creation Time: 9:11:09 AM 

Name: Online Travel Booking Services Modified : 2001-02-10 13:13:45 

RegID: 4 Planned Version : Version 1.0 = 


Lesson 6 ¢ Analyzing the Testing Process 


4 Display the customization options. 


Click the Report Customization link. The Report Customization page opens 
with the default options selected. 


Bx Requirement Report 


Requirement Report 


pr Page 


© Limit items per page to | 


© All items in one page 


m Template 
URL |hittp://cargo/tdbin/Reports/default. xsl 


© All Fields (auto-layout) 
© Custom Fields (layout) 


V) Keep Parent-Child Order (disables filter sort order) 
Show Paragraph Number 

Show Full Coverage [applied to test sub-report) 
Grid View 

V] Attachments 

v) History 


5 Set the number of items per display page. 
Select All items in one page to display all items in one page. 
6 Skip the Template box. 


You can use TestDirector’s default report template or your own template. For 
the purpose of this exercise, skip this option. 


95 


TestDirector Tutorial 


7 Define a filter to view requirements created by a specific user name. 


Click the Set Filter button. The Filter dialog box opens. 


AT Fiter [êz Sot) 


Click the Filter Condition box that corresponds to Author. Click the Browse 
button. The Select Filter Condition dialog box opens. 


E Select Filter Condition [_jorx] 
contin —*di 


Groups : 
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Under Users, select your TestDirector login user name (alice_td, cecil_td, or 
michael_td). Click OK to close the Select Filter Condition dialog box. 


Click OK to close the Filter dialog box. 
Determine the appearance and order of the fields. 


Select Custom Fields (layout) and click the Select Fields button. The Select 
Fields dialog box opens. 


Select Fields xi 


Available Fields: Wisible Fields: 


Attachment 
Author 
Cover Status 
Creation Date 
Creation Time 


Planned Version 
Priority 

Product 

ReqID 
Reviewed 
Reviewer 

Type 


The Available Fields box lists fields not currently displayed. The Visible 
Fields box lists fields currently displayed. 


In Visible Fields, select Attachment and click the left arrow button to move 
the field to Available Fields. Move Creation Time and Modified to Available 
Fields. 
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Gaasi 


To set the appearance order of the visible fields, select ReqID and use the up 
arrow button to move the field under Author. Move Name and Description 
so that they appear under ReqID. 


Select Fields xi 
Available Fields: Wisible Fields: 
Attachment Author 


Creation Time ReqID 


Modified Name 


Description 
Cover Status 

Creation Date 
[>] Planned Version 

Priority 

Product 

Reviewed 


Reviewer 
Type 


Tip: You can also use a drag-and-drop operation to determine the 
appearance and order of the fields. 


Click OK to close the dialog box and apply the new field order. 
9 Clear the Attachment and History options. 


Under the list of options, clear the Attachment and History check boxes. 


Lesson 6 ® Analyzing the Testing Process 


10 Generate a new report. 


>| Click the Generate button. The customized report is displayed. 


Requirements Report 


Filter : Author[michael_td ]; 


RegID (114) - Generic Layout 


ey eee ReaD: a4 
, 7 Creation Date : 2001-02-21 
Cover Status : Failed Ti i 
: k Priority : 4Very High 
Planned Version : Version 1.0 £ 5 
Reviewed : Reviewed 
Product : Mercury Tours Tepe: Guideline 
Reviewer : alex_td yas: 
Description : 


The similar information, like: 

- Navigation menus and buttons 

- Page headers 

- Recurring text 

- Graphics 

- Logos 

must appear in the same position on all the pages of the site. 


ReqID (115) - HTML Pages Identification 


Naer PER Cagis Identification eqD iis 
$ R D | 
Conan Gisti Tailad Creation Date : 2001-02-21 z| 


11 Add the report as a favorite view. 


Click the Add to Favorites button. The Add Favorite dialog box opens. 


In the Name box, type: Standard Requirements by Author. Click OK. The 
report is added to the Reports list in the left pane. 


12 Close the report. 
Click the Back button. The Requirements module is displayed. 


“z Tip: You can generate a quick report for a single node in a tree or row in a 
> grid. Select the requirement, test, or defect, and choose Analysis > 
7 Report Selected. 
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Generating Graphs 


TestDirector graphs help you analyze the relationships between different 
types of data in a project. Depending on the TestDirector module you are in, 
you have different graph options. After you generate a graph, you can 
customize graph properties to display information according to your 


specifications. 


In the following exercise, you will generate a defects graph to summarize the 


defects by status and priority level. 


To generate a graph: 


1 Display the Defects module. 


Click the Defects tab. The Defects module displays the Defects Grid. 


2 Choose a graph. 


Choose Analysis > Graphs > Summary. The Defects Summary graph opens. 
By default, the graph is grouped by defect status. 


<=Summary> - Group by 'Status' 


Data Grid Bar Chart 


Ga ||| 


| x Asis 


Defects - Summary Graph 


See ee beeen ee ee reer ree 
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Assigned To a 


Grouped By 


E Closed 
DO New 
E Open 
0 Reopen 


Estimated Fix Time I~] 


Lesson 6 ¢ Analyzing the Testing Process 


3 Set the X-axis of the graph. 
Select Priority from the X-Axis list to view the number of defects by priority. 


4 Define a filter to view defects with high to urgent priority. 


Click the Filter button. The Filter dialog box opens. By default, the Detected 
By field is set to the current user name—your TestDirector login user name 
(alice_td, cecil_td, or michael_td). 
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Click the Filter Condition box that corresponds to Priority. Click the Browse 
button. The Select Filter Condition dialog box opens. 


1-Low 
2-Medium 
3-High 
4-Very High 
5-Urgent 


Select the logical expression >=. 


Select 3-High. 


Click OK to close the Select Filter Condition dialog box. 
Define a filter to view defects that are not closed. 


Click the Filter Condition box that corresponds to Status. Click the Browse 
button. The Select Filter Condition dialog box opens. 


Select the logical expression Not. 


Select Closed. 
Condition : [Not Closed 


Click OK to close the Select Filter Condition dialog box. 
Click OK to close the Filter dialog box. 


Lesson 6 ¢ Analyzing the Testing Process 


6 Refresh the graph. 
Click the Refresh button. A new graph is displayed. 


Defects - Summary Graph 


E Open 
I Reopen 


In the above example, five open defects are assigned 3-High, three open 
defects are assigned 4-Very High, and one reopened defect is urgent. 


7 Display additional defect details. 


Click a bar segment in the graph. The Drill Down Results dialog box opens 
and displays the defects that define the bar segment. 
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For example, if a bar segment indicates a total of five defects, the Drill Down 
Results displays the five defects. 


E Drill Down Results BEE 
Priority: <3-High>, Status: Open, Number of items: 5 [| Select Columns... | Close 

atta [ass — Fae ae Frat a H 

| >a Open alice_td 3-High Mercury Tou Y james_td z -High TIEN TER 1.0 a Set: Mercury Tours Functionality! 

|_| 3 Open alice_td 3-High Mercury ToL Y james_td 3-High 9/2/2001 Version 1.0 Test Set: Mercury Tours Functionality! 
7 Open alice_td 3-High Mercury Tou Y peter_td 2-Medium 9/2/2001 Version 1.0 Time format used in site is incorrect. IIg 
26 Open alice_td 3-High Mercury ToL Y peter_td 4-Wery High 97/14/200 Version 1.0 Test Set: Mercury Tours Functionality! 
39 Open alice_td 3-High Mercury Tou Y mary_td 4Very High 97/24/200" Version 1.0 Test Set: Mercury Tours Functionality! 

KI » 
Bug description 

Test Set: Mercury Tours Functionality a 


Test: [1]Departing Date 
Run: Run_9-2_10-26-57 
Step: Step 1: Past Departing Date 


R&D comments 


You can modify the information in the grid, and determine the column 
appearance and order. For the purpose of this exercise, skip this option. 


Click Close to exit the Drill Down Results dialog box. 

Display other graph views. 

Click the Pie Chart tab to display the bar graph as a pie graph. 

Click the Data Grid tab to display the pie graph as a grid. 

Close the graph. 

Click the Back button. The Defects module is displayed. 

Now that you are familiar with generating reports and graphs, you can 
proceed to Lesson 7, “Where Do You Go from Here?”. In Lesson 7, you will 


apply the TestDirector concepts and skills you learned to your own 
application. 
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Where Do You Go from Here? 


Now that you have completed exercises in Lessons 1 through 6, you are 
ready to apply the TestDirector concepts and skills you learned to your own 
application. 


E In this lesson, you will learn about: 


> Getting Started 


> Getting Additional Information 


Getting Started 


Test management with TestDirector includes four phases: specifying 
requirements, planning tests, running tests, and tracking defects. 
Throughout each phase, you can analyze data by generating detailed reports 
and graphs. 


To get started: 
1 Analyze you application and determine your testing requirements. 
To specify your testing requirements, consider the following steps: 


> Examine application documentation in order to determine your testing 
scope—test goals, objectives, and strategies. 


> Build a requirements tree to define your overall testing requirements. 


» For each requirement topic in the requirements tree, create a list of 
detailed testing requirements. Describe each requirement, assign it a 
priority level, and add attachments if necessary. 
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Generate reports and graphs to assist in analyzing your testing 
requirements. Review your requirements to ensure they meet your 
testing scope. 


2 Create a test plan, based on your testing requirements. 


To create a test plan, consider the following steps: 


> 


> 


> 


Examine your application, system environment, and testing resources in 
order to determine your testing goals. 


Divide your application into modules or functions to be tested. Build a 
test plan tree to hierarchically divide your application into testing units, 
or subjects. 


Determine the types of tests you need for each module. Add a basic 
definition of each test to the test plan tree. 


Link each test with a testing requirement(s). 


Develop manual tests by adding steps to the tests in your test plan tree. 
Test steps describe the test operations, the points to check, and the 
expected outcome of each test. Decide which tests to automate. 


For tests that you decide to automate, create test scripts with a Mercury 
Interactive testing tool, or a custom or third-party testing tool. 


Generate reports and graphs to assist in analyzing test planning data. 
Review your tests to determine their suitability to your testing goals. 


3 Create test sets and perform test runs. 


> 


> 
> 
> 


Define groups of tests to meet the various testing goals in your project. 
These might include, for example, testing a new application version or a 
specific function in an application. Determine which tests to include in 
each test set. 


Schedule test execution and assign tasks to application testers. 
Execute the tests in your test set automatically or manually. 


View the results of your test runs in order to determine whether a defect 
has been detected in your application. Generate reports and graphs to 
help analyze these results. 
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4 Report defects detected in your application and track how repairs are 
progressing. 


> Report new defects detected in your application. Quality assurance 
testers, developers, project managers, and end users can add defects 
during any phase in the testing process. 


Review new defects and determine which ones should be fixed. 


y 


> Correct the defects that you decided to fix. 


> Test a new build of your application. Continue this process until defects 
are repaired. 


> Generate reports and graphs to assist in analyzing the progress of defect 
repairs, and to help determine when to release the application. 


Getting Additional Information 


For more information on TestDirector, refer to the user’s guides and online 
resources provided with TestDirector. 


TestDirector Documentation Set 


In addition to this guide, TestDirector comes with the following printed 
baled documentation: 
(ASIA 


TestDirector Installation Guide explains how to install TestDirector and the 
client database software needed to connect TestDirector to project databases. 


TestDirector User’s Guide explains how to use TestDirector to organize and 
execute all phases of the testing process. It describes how to define 
requirements, plan tests, run tests, and track defects. 


TestDirector Administrator’s Guide explains how to customize projects 
using the Project Customization window and how to create and maintain 
projects using the Project Administration utility. 
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TestDirector Open Test Architecture Guide explains how to use 
TestDirector’s open test architecture to integrate your own configuration 
management, defect tracking, and home-grown testing tools with a 
TestDirector project. It includes a complete reference to TestDirector’s new 
COM-based API. 


Online Resources 


TestDirector includes the following online resources: 


Read Me First provides last-minute news and information about 
TestDirector. 


What’s New in TestDirector describes the newest features in the latest 
versions of TestDirector. 


Books Online displays the complete documentation set in .PDF format. 
Online books can be read and printed using Adobe Acrobat Reader 5.0, 
which can be downloaded from the Adobe Web site 
(http://www.adobe.com/products/acrobat/readstep2.html). 


TestDirector Online Help provides immediate answers to questions that arise 
as you work with TestDirector. It describes menu commands and dialog 
boxes, and shows you how to perform TestDirector tasks. Check Mercury 
Interactive’s Customer Support Web site 
(http://support.mercuryinteractive.com) for updates to TestDirector help files. 


Technical Support Online uses your default Web browser to open Mercury 
Interactive’s Customer Support Web site. The URL for this Web site is 
http://support.mercuryinteractive.com. This site enables you to browse the 
knowledge base and add your own articles, post to and search user 
discussion forums, submit support requests, download patches and updated 
documentation, and more. 


Support Information presents Mercury Interactive’s Customer Support Web 
site and home page, the e-mail address for requesting information, and a list 
of Mercury Interactive’s offices around the world. 


Lesson 7 ¢ Where Do You Go from Here? 


Mercury Interactive on the Web uses your default Web browser to open 
Mercury Interactive’s home page. This site provides the most up-to-date 
information on Mercury Interactive and its products. This includes new 
software releases, seminars and trade shows, customer support, educational 
services, and more. The URL for this Web site is 
http://www.mercuryinteractive.com. 
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MERCURY INTERACTIVE 


Mercury Interactive Corporation 
1325 Borregas Avenue 
Sunnyvale, CA 94089 USA 


Main Telephone: (408) 822-5200 
Sales & Information: (800) TEST-911, (866) TOPAZ-4U 


Customer Support: (877) TEST-HLP 

Fax: (408) 822-5300 

Home Page: www.mercuryinteractive.com 

Customer Support: support.mercuryinteractive.com ETDTUTT: 6102F 


